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PREFACE 


The  aim  of  this  survey  is  to  familiarize  Western 
readers  with  some  of  the  more  important  Soviet  efforts 
concerning  a  mathematical  theory  of  computer  programming. 

It  has  grown  out  of  the  attempt  to  secure  careful  surveys 
of  Soviet  research  in  cybernetics  as  the  Soviets  understand 
this  term.  Accordingly  it  is  included  within  the  current 
Soviet  Cybernetics  Technology  Project. 

In  selecting  the  mathematical  theory  of  computer  pro¬ 
grammings  featuring  the  theory  based  on  the  operator  method 
of  A-  A.  Lyapunov,  we  have  been  governed  by  the  following 
considerations : 

1.  The  material  reviewed  should  constitute  a  serious, 
continuing  Soviet  effort. 

2.  The  material  should  contain  a  sizable  mathematical 
component . 

3.  The  material  should  in  some  significant  sense  be 
relevant  to  applications. 

4.  The  survey  should  not  present  research  that  is 
already  familiar  to  Western  experts,  and  hence  should 
pursue  topics  for  which  there  is  no  strict  analogue  in  the 
West . 

The  survey  makes  use  of  some  concepts  and  results  of 
the  theory  of  algorithms,  lattice  theory,  and  the  theory  of 
categories,  such  as  a  reader  may  find  in  Refs,  [ 3 ] ^  [5], 

[23] ,  and  [26].  It  is  to  be  emphasized,  however,  that 
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the  requisite  level  of  knowledge  of  these  disciplines  is 
quite  elementary.,  since  it  is  only  the  basic  definitions 
and  theorems  of  each  that  are  used. 
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SUMMARY 

This  report  is  about  Soviet  efforts  to  develop  a 
mathematical  theory  of  computer  programming.  For  the  most 
part,  the  study  traces  the  development  of  the  theory  which 
has  stemmed  from  the  operator  method  of  programming  of 
A.  A.  Lyapunov  from  its  starting  point  in  terms  of  program 
schemes  designed  to  represent  specific  problem-solving 
algorithms  to  its  algebraic  formulation  in  terms  of  the 
theory  of  categories.  The  latter  part  of  the  report  is 
concerned  with  the  attempt  by  various  Russian  authors  to 
adapt  graph  theory  and  the  theory  of  algorithms  to  provide 
tools  for  the  construction  of  superior  programming  lan¬ 
guages.  Illustrative  examples  as  well  as  criticism  of  the 
theory  are  included,  and  the  relation  of  the  theory  to 
automatic  programming  systems  is  discussed. 
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A  SURVEY  OF  SOVIET  WORK  IN  THE  THEORY  OF 
COMPUTER  PROGRAMMING 


1.  INTRODUCTION 

This  study  is  concerned  principally  with  a  mathematical 
theory  that  has  its  source  in  one  of  the  more  extensive 
approaches  to  computer  programming  in  the  Soviet  Union, 
the  operator  method  of  A.  A.  Lyapunov.  The  method  is  best 
regarded  as  an  alternative  to  flowcharting  as  a  means  of 
analyzing  and  representing  an  algorithm  preparatory  to 
programming.  The  counterpart  in  this  approach  of  a  finished 
flowchart  is  a  "logical  scheme  of  a  program,"  or  a  "program 
scheme."  There  is  a  difference  in  form:  A  flowchart  is  a 


planar  arrangement  of  boxes  with  connecting  arrows,  while 
a  scheme  is  a  linear  string  of  symbols  called  "operators." 
Thus,  a  scheme  is  linguistic  rather  than  diagrammatic,  that 
is,  it  represents  an  algorithm  as  a  linear  sequence  of 
letters  that  symbolize  various  arithmetic  or  logical  opera¬ 
tions.  These  operators  are  indexed  with  various  letters 
that  generally  vary  over  some  finite  set,  thereby  indicating 
the  range  of  objects  upon  which  the  operator  acts.  For 


example,  if  (a.  .)  and  (b...  )  are  n  X  n  matrices,  the  symbol 
"A^k"  could  signify  the  operation  of  forming  the  product 
a.  .  •  b.n  .  Here  each  of  i,  j,  k  varies  from  1  to  n. 

Indices  also  appear  in  operators  to  specify  which  parameters 


occurring  in  some  given  operation  are  to  assume  in  succes¬ 
sion  some  finite  range  of  values  upon  satisfaction  of 
some  logical  condition.  This  corresponds  to  the  use  of 
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readdressing  instructions  in  a  program  to  govern  execution 
of  a  loop.  Flowcharting  is  the  more  basic  and  heuristic 
procedure;  that  is,  in  constructing  a  program  scheme  of  a 
complex  program  one  would  almost  inevitably  find  himself 
drawing  diagrams,,  or  flowcharts ,  as  an  aid.  If  one  were, 
on  the  other  hand,  to  develop  a  theory  about  flowcharts, 
he  would  presumably  proceed  by  first  replacing  the  blue¬ 
print  format  of  a  flowchart  with  a  more  amenable  formalism, 
much  like  that  of  program  schemes. 

1.1.  Description  of  the  Method. 

Underlying  the  procedure  is  the  conception  of  a  program 
as  a  complex  operator,  acting  upon  the  contents  of  the 
storage  cells  of  a  computing  machine,  and  representing  a 
sequence  of  operators  of  several  different  types.  The 
basis  for  this  view  is  the  fact  that  the  instructions  of 
a  program  resolve  conveniently  into  several  groups,  within 
each  of  which  the  prescribed  operations  are  rather  homo¬ 
geneous.  Examples  of  such  groups  of  operations  are 
arithmetical,  logical  and  control,  readdressing,  dispatch, 
and  the  like.  Each  of  the  groups  of  homogeneous  operations 
may  be  labeled  as  an  "operator,"  and  the  arrangement  of 
the  operators  in  some  order  specifies  the  action  of  the 
program.  This  provides  the  basis  for  a  formal  description 
of  the  programming  process,  and  the  need  and  the  oppor¬ 
tunity  arise  for  making  this  description  more  complete  by 
a  thorough  classification  of  operators,  for  the  development 
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of  general  methods,  and  for  the  consideration  and  evaluation 
of  different  arrangements  of  the  operators — all  toward  the 
end  of  achieving  an  adequate  formalization  of  programming. 

The  following  classification  of  the  "standard" 
operators,  together  with  their  common  designation,  is  given 
by  Lyapunov  [21]  and,  with  minor  modifications,  it  has 
generally  been  adopted  for  use  in  standard  Soviet  texts  on 
electronic  computing  machines  [20]: 

A,  arithmetical  operator — prescribes  calculations 

P,  logical  operator — evaluates  a  logical  condition 

F,  readdressing  operator — alters  the  value  of 

parameters  indexing  some  operator;  corresponds 
to  those  instructions  in  a  program  that  change 
the  addresses  appearing  in  some  instructions. 

I,  forming  operator — generates  the  initial  form  of 
some  operator  in  a  program. 

§,  restoring  operator — restores  the  initial  form  of 
some  operator  by  restoring  the  initial  values  of 
parameters  indexing  the  operator. 

Z,  transfer  operator — transfers  numerical  data  from 
one  location  to  another.  These  operators  are  also 
written  as  "[a  -  b],"  where  a  is  the  data  to  be 
transferred  and  b  is  the  location  to  which  a  is 
transferred . 

All  other  operators  are  described  as  "nonstandard" 
and  are  frequently  designated  by  H. 

Let  us  consider  a  simple  example.  A  program  is  to  be 
written  to  compute  the  function 

cp(x)  =  f  (x^  +  x  —  1)  , 


where 
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f(y) 


y3- 

1 

if  |y|  <  ly 

2y  - 

1 

if  1  <  |y|  <  2, 

5 

b- 

1 

if  1 y 1  >  2. 

One  proceeds  directly  to  construct  a  logical  scheme  for 
the  program  as  follows.  First  the  operators  are  defined: 
IIq  —  introduces  the  program. 

A-^  —  transforms  the  initial  data  into  binary  form 

2 

A2  —  computes  the  function  y  =  x  +  x  —  1. 

—  tests  the  condition  1  —  |y|  >0.  If  this  condition 
is  satisfied,  pass  to  operator  A^.  If  the  condition 
tested  by  P^,  or,  briefly,  condition  P^,  is  not 
satisfied,  transfer  to  operator  P^. 

A^  —  computes  f(y)  =  y  —  1. 

Pt-  —  tests  the  condition  2  —  |y|  >  0.  If  P^  is  not 

satisfied,  then  transfer  to  operator  Ay. 

kr  —  computes  f(y)  =  2y  —  1. 

b  5 

Ay  —  computes  f(y)  =  ^ -  1. 

kD  —  converts  the  result  of  the  computation  into  decimal 

O 

form. 

II g  —  punches  out  the  result. 

—  stops  the  machine. 

The  logical  scheme  of  the  program  is 

noA^^A^i^A^iyAgn  9^10 

1 _ it - 1 


The  passage,  of  course,  is  from  left  to  right. 
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Here  the  upper  arrows  designate  the  order  of  execution 
of  the  operators  upon  satisfaction  of  some  logical  condition. 
For  instance,  the  arrow  above  "P^"  means  that  control  is 
transferred  to  P^  if  P^  does  not  hold.  Otherwise,  control 
passes  to  A^.  The  lower  arrows  indicate  unconditional 
transfer  to  the  operator  to  which  the  arrow  leads  following 
execution  of  the  operator  from  which  the  arrow  originates. 

In  order  to  linearize  the  operator  representation,  the 
upper  arrows  are  replaced  by  a  pair  of  half— brackets  having 
the  same  index.  The  left  half-bracket  is  situated  immediately 
to  the  right  of  the  operator  from  which  the  arrow  originates, 
and  the  right  half-bracket  is  situated  immediately  to  the  left 
of  the  operator  to  which  the  arrow  leads.  The  lower  arrows 
are  replaced  by  (1)  the  false  proposition  denoted  by  "0," 
to  the  right  of  the  operator  from  which  the  arrow  originates; 

(2)  an  immediately  following  indexed  left  half-bracket;  and 

(3)  a  right  half-bracket,  having  the  same  index  as  the  left, 
to  the  immediate  left  of  the  operator  to  which  the  arrow 
leads.  It  is  understood  that  no  distinct  pairs  of  half- 
brackets  have  the  same  index.  The  scheme  thus  becomes 

n0AlA2P3  LA4°I _ 1  ^5  L  A6°  I — 1A7— 1  JA8n9^lO  ' 

U  iZ  J1  4  2r  3  43  2  4 

The  operators  of  this  scheme  can  be  programmed 
separately  and  the  resulting  subprograms  fitted  together  in 
accordance  with  the  plan  of  the  scheme.  At  this  stage 
the  program  is  ready  to  be  punched  and  run  on  the  machine. 
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1.2.  Transformations  of  Program  Schemes 

The  theory  of  operator  programming  is,  more  than 
anything  else,  an  investigation  of  the  effects  of  various 
types  of  transformations  on  program  schemes.  A  major  aim 
is  to  classify  those  transformations  that  give  rise  to  a 
scheme  equivalent  to  some  given  scheme  in  the  sense  of 
prescribing  a  program  that  will  solve  the  same  problem, 
or  in  some  stronger  sense,  but  that  exhibits  some  technical 
advantage.  For  example,  transformations  on  the  logical 
conditions  present  in  a  logical  scheme  according  to  various 
rules  of  the  propositional  calculus  may  lead  to  a  simpli¬ 
fication  in  the  form  of  these  conditions  that  facilitates 
the  actual  programming.  Again,  transformations  on  the 
parameters  indexing  the  arithmetical  operators  may  be 
designed  to  take  advantage  of  some  feature  of  the  problem, 
such  as  symmetry  in  the  case  of  matrix  calculations,  and 
lead  to  a  new  indexing  that  makes  more  economical  use  of 
the  memory  of  the  machine. 

1.3.  Programming  Programs 

The  first  Soviet  attempts  at  automatic  programming, 
resulting  in  "programming  programs"  (PP),  were  based  on  the 
operator  method.  Indeed,  Turski  in  [33]  asserts:  "On 
r considering  Soviet  achievements  in  automatic  programming 
one  can  easily  notice  that  a  great  part  of  the  work  done 
on  the  problem  is  connected  in  one  way  or  another  with 
Professor  Lyapunov  of  Moscow  University."  The  feasibility 
of  a  PP  lies  in  this:  the  basic  structure  of  the  operators 
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of  each  of  the  types  A,  P,  Z,  F,  and  §  does  not  vary  with 
the  algorithm  to  be  programmed.  This  basic  structure  may 
be  programmed  as  a  collection  of  "generalized  instructions" 
that  are  translated  into  machine  language.  Thus,  a  pro¬ 
gram  is  constructed  which,  when  supplied  with  the  encoded 
form  of  a  logical  scheme  for  a  program  and  with  the  data 
realizing  the  operators  in  the  given  scheme,  will  assemble 
a  program  prescribed  by  the  logical  scheme.  For  example, 
a  generalized  instruction  associated  with  a  logical  operator 
could  be:  "Evaluate  a  given  logical  function  of  several 
arguments  and,  depending  on  whether  it  is  equal  to  zero  or 
unity,  execute  one  or  another  generalized  instruction  of 
the  algorithm. " 

The  information  about  the  operators  which,  in  coded 
form,  constitutes  part  of  the  input  to  a  PP  may  be  summarized 
as  follows. 

1.  A— operator:  an  ordered  list  of  the  calculation 
formulas  to  be  used. 

2.  P— operator:  the  logical  condition  to  which  P 
refers,  specifying  its  constituent  elementary  logical 
conditions  and  the  indices  of  the  operators  that  are  to 
be  executed  depending  upon  the  truth  or  falsity  of  the 
condition. 

r 

3.  F— operator:  the  operators  whose  addresses  are  to 
be  modified  by  F  and  the  address  of  the  corresponding 
parameter. 
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4.  Z-operator:  the  quantities  to  be  transferred  to 
the  standard  cells  and  the  addresses  of  the  operators  in 
which  these  quantities  are  to  be  replaced  by  the  contents 
of  the  standard  cells. 

5.  $— operator:  the  addresses  of  the  operators  to  be 
restored. 

6.  H-operator:  the  list  of  machine  instructions 
comprising  H.  Thus  nonstandard  operators  receive  a  different 
treatment  from  that  of  the  other  types  of  operators.  The 
generalized  instruction  corresponding  to  H  is  typically  of 
the  form:  "Carry  out  a  given  list  of  elementary  machine 
instructions."  These  machine  instructions  are  written 
manually  by  the  programmer. 

Additional  input  data  for  the  PP  relates  to  the  assembled 
program  as  a  whole: 

1.  A  table  of  the  contents  of  the  elementary  logical 
conditions . 

2.  A  table  describing  the  indexing  of  the  initial 
data  of  the  problem  and  the  transformations  that  may  lead 
to  a  new  indexing  of  this  information. 

3.  A  table  of  auxiliary  constants. 

4.  A  table  describing  the  working  cells. 

5.  A  table  of  storage  distribution  indicating  the 
addresses  in  which  quantities  used  in  calculations  are 
stored . 

6.  The  address  of  the  cells  at  which  the  program 
begins . 
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7.  The  permissible  length  of  the  program. 

8.  The  address  of  the  cell  to  which  control  should 
be  transferred  at  the  end  of  the  program. 

The  reader  will  observe  that  the  above  information 
includes  implicitly  the  logical  scheme  of  the  program. 

All  of  this  information  is  encoded  in  numerical  form 
on  program  sheets,  from  which  it  is  transferred  to  punched 
cards  that  are  read  into  the  machine. 

The  reader  can  find  extensive  descriptions  of  program¬ 
ming  programs  based  on  the  operator  method  in  [6]  and 
[19].  Some  critical  comments  on  PPs  are  included  in 
Par  t  4 . 


1.4.  Organization  of  the  Survey 

Part  2  traces  the  development  of  the  theory  of  operator 
programming.  First,  a  presentation  is  given  of  the  initiat¬ 
ing  paper  of  Lyapunov  [21].  The  subsequent  section  is 
concerned  with  the  study  of  transformations  of  program 
schemes  and  divides  naturally  along  logical  and  nonlogical 
lines.  The  work  of  Yanov  on  the  transformation  of  the 
logical  conditions  present  in  a  program  scheme  is  covered, 
while  the  discussion  of  nonlogical  transformations  is  based 
chiefly  on  papers  of  Podlovchenko  and  Arsenteva  [2,  27,  28]. 

A  paper  of  Podlovchenko  [29]  is  presented  as  a  reca¬ 
pitulation  of  basic  terminology  and  notions  of  the  theory 
from  a  more  abstract  point  of  view.  It  may  serve  as  a 
summary  of  the  notions  so  far  developed. 


-10- 


The  algebraic  treatment  of  programming  is  described 
in  2.4.  In  this  treatment  the  initiating  paper  is  again 
due  to  Lyapunov  [22];  two  papers  by  Glebov  [14],  [15]  are 

also  included.  Again  the  motive  is  the  characterization  of 
transformations  operating  on  program  schemes,  but  now  the 
treatment  is  quite  abstract;  the  framework  is  that  of 
lattice  theory  and  the  theory  of  categories. 

Part  3  of  the  survey  is  concerned  not  with  the  theory 
having  the  operator  methods  as  its  source,  but  with  the 
attempt,  initiated  by  Kaluzhnin  in  [18],  to  develop  methods 
and  a  formalism  aptly  suited  for  the  description  of  algorithms 
to  be  programmed,  and  with  the  related  and  derived  efforts 
of  Ershov  [10,  11]  to  reformulate  the  theory  of  algorithms  to 
render  it  more  suitable  for  the  study  of  problems  arising 
in  the  theory  of  programming.  In  this  connection,  the  work 
of  Zaslavskii  [36]  is  also  mentioned. 

Our  aim  has  not  been  to  cover,  or  even  mention,  all 
Soviet  papers  that  touch  on  the  pertinent  topics,  but 
rather  to  select  representative  papers  and  organize 
them  into  a  coherent  framework.  A  number  of  the  papers 
are  treated  in  some  detail  so  that  the  reader  can  become 
fully  acquainted  with  the  mathematical  setting  and 
methods  should  he  wish  to  conduct  similar  research  or 
pursue  open  problems.  On  the  other  hand,  the  technical 
developments  are  always  preceded  by  a  informal  statement 
of  the  aims,  main  results,  and  methods  of  the  papers 
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sufficiently  complete  to  allow  the  reader  to  omit  the 
details  should  he  be  so  disposed.  Occasional  critical 
comments  are  interspersed  throughout  the  study.  In  the 
final  part.  Part  4,  summarizing  comments  are  given,  and 
several  questions  are  posed  concerning  the  further  development 
and  use  of  the  theory. 
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2.  THE  OPERATOR  THEORY  OF  PROGRAMMING 

2.1.  Informal  Statement  of  the  Basic  Notions 

The  aim  of  this  section  is  to  introduce  a  formalism 
|that  provides  the  means  for  a  symbolic  description  of  pro¬ 
grams  composed  to  solve  particular  problems  and  to  indicate 
the  possible  lines  that  a  theoretical  development  might 
take.  The  main  source  of  the  exposition  is  due  to  A.  A. 
Lyapunov  [21]. 

The  initial  representation  of  an  algorithm  in  this 

i formalism  is  a  calculation  scheme — a  finite  sequence  of 

(  " 

| symbols ,  each  one  of  which  is  either  an  operator  Ai  or  a 
logical  condition  Pj •  One  should  think  of  the  operators  as 
acting  on  the  contents  of  some  cells  in  the  memory  of  a 
computer.  A  sequence  of  juxtaposed  operators  is  termed 
their  product.  The  action  of  an  operator  frequently  depends 
on  the  parameters  with  which  it  is  indexed.  To  illustrate, 
we  construct  a  calculation  scheme  for  the  product  C  =  A  *  B 
of  two  n  x  n  matrices  A  and  B.  Let  operator  A^^  represent 
the  multiplication  a.  .b.,  of  elements  a..  and  b.^  and  addi— 
tion  of  the  result  to  the  contents  of  the  cell  in  which  c.^ 
is  to  be  stored.  Then 


n 


n  a 

j=i 


ijk 


is  the  scheme  of  calculation  for  element  c.^. 


and 
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n  n 

n  n 

k=l  j=l 


is  the  scheme  o£  calculation  for  the  i— th  row  of  C  =  A  *  B. 
n  n  n 

Finally,  II  II  n  A..,  is  the  calculation  scheme  for 
i=l  k=l  j=l  1Jk 
forming  the  product  A  •  B. 

A  calculation  scheme  is  obviously  a  primitive,  skeletal 
representation  of  an  algorithm.  It  makes  no  provision  for 
loops — the  iterated  execution  of  some  sequence  of  operators 
in  some  fixed  order.  A  program  scheme,  as  defined  below, 
is  a  development  of  a  calculation  scheme  in  which  the  role 
of  the  control  operators  is  more  fully  specified. 

The  control  operators  are  broken  down  into  the  following 
categories:  (1)  readdressing  operators,  (2)  restoration 

operators,  (3)  formation  operators,  (4)  parameter  change 
operators,  (5)  transfer  operators,  (6)  logical  condition 
switching  operators,  (7)  parameter  introducing  operators. 
(Such  a  list  is,  of  course,  in  part  conventional,  and  a 
little  work  could  result  in  one  having  17  categories 
instead  of  7 . ) 


A  program  scheme,  then,  is  a  finite  sequence  of  symbols, 

each  of  which  is  either  an  operator,  denoted  by  indexed 

j  j 

capital  Roman  letters,  or  a  logical  condition  p^j.,  or  P-^ 
consisting  of  a  proposition  p^  and  an  indexed  upward  arrow 
or  an  indexed  downward  arrow  Frequently,  the  logical 

conditions  present  in  a  scheme  take  the  form  of  such  state¬ 
ments  as  Mp(i>j)",  which  is  true  if  i>j ,  and  false  otherwise. 
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The  manner  of  execution  of  a  program  scheme;  for  some 

assignment  of  values  to  the  parameters  present  in  the 

scheme,  is  as  follows.  Begin  at  the  extreme  jleft  and 

proceed  to  the  right  until  an  operator  A.  or  a  logical 
k 

condition  p ^ f  is  encountered.  If  the  encountered  symbol 

is  an  operator  A^,  it  is  executed  and  the  movement  to  the 

right  is  resumed;  if  it  is  a  logical  condition  and  p  =  1 

(=  truth)  for  the  given  assignment,  again  move  to  the 

right,  if  the  value  of  p.  is  0,  and  then  "branch  out" 

k 

and  enter  the  scheme  immediately  to  the  right  of  J,.  This 
procedure  may  go  on  indefinitely  or  may  involve  execution 
of  the  operator  STOP,  at  which  point  the  process  comes  to 
a  halt.  (One  can  be  more  precise  about  the  syntax  of  program 
schemes,  but  at  this  point,  such  rigor  seems  misplaced.) 

The  program  scheme  based  on  the  above  calculation 
scheme  for  the  multiplication  of  two  matrices  is  as  follows 


1,2,3  1  _  2 

l  A.  kF(j)p(j>n)tF  n(j)F(k)p(k>n)tF  n(k)F(i) 


p(i>n)t  STOP.  Starting  values:  i  =  j  =  k  =  1. 


Here,  an  operator  of  the  form  F(m  •  i)  means  "increment 
parameter  i  by  m  units."  F(m  •  i)  is  called  a  readdressing 
or  restoration  operator,  according  as  m  >  0  or  m  <  0 .  We 
write  Fm(k)  instead  of  F(mk). 

In  some  cases,  more  than  one  algorithm  may  solve  a 
given  problem.  These  give  rise  to  distinct  calculation 
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schemes,  and  these,  in  turn,  to  distinct  program  schemes. 
Comparison  of  these  schemes  could  hopefully  lead  to 
selection  of  the  better  program.  ’’Better11  here,  of  course, 
has  a  contextual,  but  obvious,  sense.  The  scheme,  or 
resulting  program,  may  be  better  than  another  in 
facilitating  programming  or  allowing  for  superior  machine 
operation. 

As  an  example,  let  us  consider  the  problem  of 
calculating  the  determinant  of  an  n  x  n  matrix  (a„  ) .  A 
is  assumed  to  be  in  upper  triangular  form,  and  the  determin¬ 
ant  is  computed  as  the  product  of  the  diagonal  elements. 

So,  for  i  >  j  we  have  the  operators 

:  evaluate  c  =  aj  3l±±  anc*  store  • 

^ijk'  evaluate  a^  =  a^  —  ca^  and  store  in  the 
location  of  aj^- 

D  :  multiply  a-,  by  a  and  store  in  the  location  of 
m  11  mm 

all'  Calculation  schemes: 


(1) 

(2) 


(n  n  n  \  n 

1-1  j-i+1  ^  k-l  m==2 

(ll  jl  ^  jlP(i>J)AiJk)  J2  "»■ 
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Scheme  (1)  gives  rise  to  the  following  program  scheme: 

2  3  1  1  ■  2 
i  Bij  |  A.jkF(k)p(k>n)  f  F_(n_l)(k)F(j)p(j>n)t 

3  4  4 

F_(n“1+l)(j)F(i)p(i>n)t  J,  DmF(m)p(m>n)  f  STOP 

Scheme  (2)  gives  rise  to 

34  2  11  2  3 

i  Bi-  ^  P  (i<j  )  f  Ai^k  l  F(k)p(k>n)  |  F  n  (k)F  (j  )p  (j  >n)  t 

4  5  5 

F- m(j  )F  (i)p  (i>n  )  |  i  DmF(m)p(m>n)  f  STOP. 

The  first  of  these  schemes  contains  more  orders  than 
■the  second,  since  F(i)  must  operate  on  all  instructions 
of  the  form  F  ^(k)  and  F  (j )  ■  On  the  other  hand, 

the  second  requires  more  cycles  since  F (k)  and  F(j)  readdress 
without  any  computation  taking  place  until  k  =  n  +  1  or 
j  =  i  +  1.  A  choice  is  to  be  made  between  these  two  schemes 
on  the  basis  of  some  criterion. 

The  tone  and  style  of  Lyapunov's  paper  [21]  are  loose 
and  heuristic.  There  is  no  substantive  mathematics  in  the 
paper,  but  neither  was  there  meant  to  be.  Questions  are 
raised  that  form  the  basis  for  papers  that  follow.  For 
example,  it  is  noted  that  the  question  of  equivalent 
rearrangements  of  program  schemes  should  be  investigated, 
one  arrangement  possibly  leading  to  the  construction  of  a 
'’better"  program  than  another.  This  leads  directly  to  the 
work  of  Yanov,  which  is  discussed  in  the  next  section.  Also, 
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Lyapunov  considers  a  number  of  other  examples  such  as  a 
detailed  example  of  solving  the  Dirichlet  problem  using  a 
varying  net  mesh.  The  paper  also  describes  a  technical 
device  (logical  scales)  used  to  change  the  logical  condi¬ 
tions  in  a  program  scheme  in  the  course  of  the  computation. 

2.2.  Transformations  on  Program  Schemes 

2.2.1.  Transformations  of  the  Logical  Conditions. 

In  order  to  treat  adequately  and  precisely  the  question  of 
rearrangement  of  program  schemes  by  changes  in  their  logical 
conditions,  the  formal  structure  of  these  schemes  must  be 
more  adequately  defined.  This  is  achieved  in  a  paper  by 
Yu.  I.  Yanov  [35].  This  paper  introduces  a  formal  system, 
an  interpretation  of  which  is  the  program  schemes  of  Lyapunov. 

In  this  connection,  the  questions  investigated  are  of  a 
metalogical  character,  questions  of  the  equivalence  of 
schemes  under  a  certain  system  of  logical  transformations 
and  the  completeness  of  this  system.  The  letters  that 
represent  operations,  the  operator  symbols,  now  assume  the 
status  of  primitives,  and  the  logical  scheme  looks  much  like 
a  program  scheme  except  that  the  up  and  down  arrows  have  been 
traded  in  for  left  and  right  half  brackets,  respectively. 

Generally  speaking,  the  problems  treated  by  Yanov  amount 
to  considering  the  effect  on  a  logical  scheme  of  transformations 
of  the  logical  variables  contained  therein.  Two  such  problems 


are: 
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(1)  Under  a  suitable  definition  of  equivalence,  can 
the  equivalence  of  two  logical  schemes  be  decided  by  some 
uniform  effective  procedure? 

(2)  Can  a  system  of  logical  transformations  be  devised 
i  that  will  generate  all  logical  schemes  equivalent  to  a 
given  one? 

Yanov  solves  these  problems  in  the  affirmative  for  two 
kinds  of  logical  schemes,  a  one— dimensional  or  linear  type 
and  a  two-dimensional  or  matricial  (rectangular)  variety. 

He  also  considers  the  question  of  the  equivalence  of  a 
linear  to  a  matricial  scheme,  and  shows  how  to  pass  from  one 
to  another. 


We  assume  that  we  have  the  usual  apparatus  of  the  proposi¬ 
tional  calculus.  If  a  is  a  propositional  variable  and  L- 

is  a  left  half— bracket ,  then  a[_  is  a  logical  condition. 

i 

A  logical  scheme  of  an  algorithm  is  a  finite  sequence  of 

symbols  composed  of  operator  symbols  A1 ,  A  ,  . . . ,  logical 

1  2 

conditions  al  ,  .  .  .,  and  right  half— brackets  _[,  .  .  .  , 

l  j  i  j 

such  that  for  each  left  half— bracket  1 _  with  index  i  appearing 

i 

in  the  sequence  there  is  exactly  one  right— half  bracket  j_] 

i 

with  index  i,  and  conversely.  It  is  understood  that  an 
operator  has  at  most  one  occurrence  in  a  logical  scheme. 

We  must  define  what  makes  a  (linear)  logical  scheme 


CU.V1>  P2 


pk,  A1,  A2,  ...,  An)  "go",  that  is,  the 


procedure  by  which  the  scheme  is  executed.  Let  A^  ,  A2, 

k 

...,  A^k  denote  the  2  possible  assignments  of  values  to 
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the  logical  variables  p-^,  P2>  •  •  •  3  P^3  and  suppose  an 

infinite  sequence  A  ,  A  ,  . . . ,  of  such  assignments  is 

S1  s2 

given . 

Step  1.  Assign  Ag  to  p-^,  P23  •  •  •  ^  and  mark  the 
left— most  symbol  in  (X. 

Suppose  that  l  steps  have  been  carried  out  with  the  result 

that  the  operators  A.  ,  A.  ,  •  ••,  A.  have  been  marked 

11  12  1m— 1 

and  that  some  symbol  S  of  CL  has  been  marked  in  the  t— th  step. 

Step  ( t  +  1)  is  defined  as  follows: 

(a)  If  S  is  an  operator  A^  ,  adjoin  it  to  ,  A^  , 

m  1  2 

....  A.  on  the  right,  giving  A.  ,  A.  ,  ...,  A.  ;  assign 
1m— 1  X1  2  m 


3m+l 


to  p^,  P2^  -  p^;  and  mark  the  symbol  in  to  the 


immediate  right  of  A^ 

i 

(b)  If  S  =  a(p,  ,  .  ..,  p,)L_  3  then  if  a(A  )  =  1,  the 
1  K  i  fam 

symbol  to  the  immediate  right  of  ct(p1,  ...,  pk)  L_  is 


ma 


rked ,  whereas  if  a  (A  )  =  0,  the  symbol  in  O.  to  the 


m 


immediate  right  of  _J  is  marked. 

i 

(c)  If  S  =  _ [  for  some  i,  the  symbol  to  the  immediate 

i 

right  of  _ j  in  Cl  is  marked. 

i 

No  symbol  is  marked  in  step  (£  +  1)  except  as  specified  by 
(a),  (b)  or  (c).  Otherwise,  the  process  terminates. 

Knowing  the  input  and  manner  of  operation  of  a  scheme 
&( p^,  ...,  p^,  A^ ,  ...,  An),  what  is  one  to  understand  as 

the  output  or  value  of  the  scheme?  Yanov  chooses  to  define 
the  output  of  /2(p^,  •  •  •  ,  Pj^j  A^,  .  .  .  ,  Ar)  to  mean  the  entire 
sequence  of  calculations,  including  the  order  in  which  they 
are  performed.  Thus,  the  value  of  the  scheme  for  a  given 
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assignment  is  the  sequence  of  marked  operator  symbols.  The 
value  may  be  infinite  or  it  may  be  finite  even  though  the 
scheme  is  executed  indefinitely.  In  the  latter  case3  the 
value  is  termed  an  empty  period ,  and  a  pair  of  parentheses., 
(  ),  is  written  to  the  right  of  the  value. 

As  an  application ,  consider  the  normal  algorithm  CL 
over  a  finite  alphabet  A  with  the  scheme 


pn  "  % 

where  p  -»  •  Q  is  the  final  formula  [23]. 
s  s 

Let  p^^  stand  for  the  assertion:  "The  word  P.^  goes  over 
into  the  transformed  word”;  and  let  A^  represent  the  sub¬ 
stitution  of  the  word  Qi  for  the  first  appearance  of  the  word 
in  the  transformed  word.  With  this  interpretation  of  the 
logical  variables  p^  and  the  operators  A^ ,  the  scheme 


^.(Pp  •  •  •  j  Pn*  Ai>  •••  *  An) 


J  J  J  J 

n+1  n  n+s— 1  n+s+1 


•  J  Pi  L  Ai°  1 _ I  P2  L  a2  0  L  ... 

In  1  1  1  n+1  1  2  n+I 


•  •  •  J  ps  L  As  0  L  •  •  •  J  pn  L  An  0  — 1  J 

s — 1  s  s  n+s  n— 1  n  2n  n  n+s 


represents  the  given  normal  algorithm. 

Let  us  write  V(<2)  for  the  value  of  scheme  a  for  some  given 
assignment.  Consider  the  scheme  <^(p^.>  P£>  Ai->  A2^  =  — lPlL_A]__i 
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L  a„.  For  the  assignment  (1,0),  (0,  0)  ,  (0,  0)  ,  • 

2  1 

V((2)  =  Ax(  ),  whereas  for  the  assignment  (1,0),  (1,  0), 

(1,  1),  .  ..,  V((2)  =  A1A1A2 .  Now,  according  to  the  above 
definition  of  execution,  the  values  of  the  logical  variables 
of  a  scheme  may  change  only  as  an  operator  is  executed. 

The  variation  of  the  logical  variables  controls  the  order 
in  which  the  operation  of  the  scheme  is  carried  on.  In 
applications,  this  amount  of  "transferring"  can  depend  on 
the  nature  of  the  operators.  On  the  theoretical  level 
this  is  reflected  in  Yanov ' s  notion  of  a  shift  distribution, 
which  is  central  to  his  entire  development.  The  manner  in 
which  the  logical  variables  are  allowed  to  change  values  should 
be  closely  connected  with  the  operators;  it  proceeds  as 
follows.  A  shift  distribution  can  be  thought  of  as  a  mapping 
of  the  set  of  operators  A^  appearing  in 

V23  '•'*  PkJ  A1J  A2j  ’  '  ’  ’ 


into  the  set  of  subsets 

Bi  of  B  =  [px,  p2,  •  •  •  >  Pk)  ,  and  is  denoted  by  A±  -  B^ 

When,  in  accordance  with  the  definition  of  operation  of  a 

scheme,  the  operator  A^  is  to  be  executed,  only  the  variables 

in  B^  are  allowed  to  assume  new  values,  although  they  may 

|also  maintain  the  same  values. 

More  precisely,  suppose  that  for  a  given  assignment 

A  ,A  ,  A  ,  ...,  A  the  scheme  (2(p-i,  Pk>  A^ , 

S1  s2  S3  Sm 

...,  A  )  with  shift  distribution  A.  —  B,  has  value  A.  ,  A., 
n  1  ■*-  -*-2 
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A.  The  given  assignment  is  admissible  with 

1m  _ 

respect  to  this  distribution  if  for  all  m,  Ag  -  Ag  or 


A  differs  from  A  in  the  values  of  variables  in  B^  . 

Sm+1  Sm  “  A 

For  example,  if  UX P^j  ?2’  A1J  A2^  =  P1 1—  A1  -jl-J  A2  p2  ^  ' 

the  shift  distribution  A-^  —  {p-^}  ,  “^^2^  is  §iveib  the 

assignments 

(1)  (1,0),  (0,0),  (0,1),  (0,1),  ... 


and 

(2)  (1,0),  (1,0),  (1,0),  (1,0),  ... 

are  admissible,  whereas  the  assignment 

(3)  (1,0),  (1,0),  (0,0),  (0,0),  ... 

is  not  admissible. 

Now,  two  algorithms  may  be  said  to  be  equivalent  in 
several  different  ways.  Most  generally,  two  might  be 
considered  equivalent  if  they  give  the  same  (or  isomorphic) 
outputs  for  the  same  (or  isomorphic)  inputs  no  matter  how 
differently  the  process  of  computation  is  carried  out;  their 
"programs”  could  be  very  different.  With  this  definition 
the  general  problem  of  deciding  whether  two  algorithms  are 
equivalent  is,  as  is  well  known,  recursively  unsolvable.  Since 
we  have  already  stated  that  Yanov  shows  that  the  equivalence 
problem  is  solvable,  it  is  to  be  expected  that  he  employs 
a  rather  strong  definition  of  equivalent  schemes.  Indeed, 
two  schemes  #(p-^,  •••*  •••,  An)  and  •••,  P^y 

A ...,  A^)  are  equivalent  in  Yanov’s  sense  with  respect 
to  a  shift  distribution  B  if  they  have  the  same  values  for  all 
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admissible  assignments.  Thus,  if  two  schemes  are  equivalent 
for  a  shift  distribution,  they  produce  the  same  sequence  of 
operations  for  all  admissible  inputs  and  all  interpretations 
of  the  operator  symbols. 

Equivalent  schemes  need  by  no  means  be  identical.  They 
may,  in  fact,  not  be  equivalent  with  respect  to  some  other 
shift  distribution. 

The  schemes 

Q.(P^>  P2’  ^2)  =  ^1  ^2  I I ^1^2^ — J-^2^ 

and 

6(pi>  v2>  Ai>  "Pi  •  P2L  A2°  L  J  J  aiP2L  J' 

1  2  13  3  2 

where  0  is  the  false  proposition,  are  clearly  equivalent 
with  respect  to  the  universal  distribution,  that  is,  where 
B-^  =  (Pp  P2}  =  ^2*  schemes  that  are  equivalent  with 

respect  to  the  universal  distribution  are  equivalent  with 
respect  to  any  shift  distribution,  since  for  the  universal 
distribution  all  sequences  of  assignments  are  admissible. 

On  the  other  hand,  the  schemes 

d(?1,  p2,  A1,  A2)  =  PXL  P2I _ 1  AiP2  V  <Pi-P2)L_  a2°1 _ IJJ 

1  2  3  4  3421 

and 

p(P]_,  p2,  A1,  A2)  =PiL  P2  t _ l  aiPLV  (P1-P2)L  A2  °1 _ IJJ 

1  23  4  3421 

are  obviously  equivalent  with  respect  to  the  empty  distribu¬ 
tion  in  which  only  the  constant  sequences  are  admissible, 
but  they  are  not  equivalent  with  respect  to  the  shift 
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distribution  A-^  —  f  P2 3  ^  A£  —  Consider  the  sequence 

(1,1),  (1,1),  (1,1),  (1,0),  (1,0),  (1,0),  .... 

In  this  case,  V(<2)  =  A-j^A^  and  V  ($)  =  A;LA2AlA2^lA2  A]_A2  •  •  • 

Here  the  sequence  is  admissible  for  both  CL  and  ,  but  the 
values  of  (?and  ^are  different.  Hence,  L2-  is  not  equivalent 
to  for  this  distribution. 

It  is  obvious  that  equivalence  with  respect  to  the 
empty  distribution  is  solvable  for  schemes  (2(p^,  P2,  Pk, 

Al,  A2,  •••,  An)  and  ^f(p±,  p2>  •  •  •  ■»  Pk,  A]_;  A2j  An^ 

since  one  needs  only  to  examine  the  2  possible  assignments. 

This  simple  fact  is  important  in  that  a  recurrent  theme 
throughout  Yanov's  paper  is  this:  A  problem  concerning  two 
schemes  &  and  ^with  respect  to  an  arbitrary  shift  distribution 
is  translated  into  a  closely  related  problem  concerning 
closely  related  schemes  0-  and  C>  with  respect  to  the  empty 
distribution.  In  particular,  in  regard  to  the  problem  of 
deciding  the  equivalence  of  a  pair  of  (linear)  schemes,  it 
is  demonstrated  that  each  scheme  (^with  a  given  shift  distri¬ 
bution  can  be  transformed  into  a  certain  canonical  form 
CL^\  called  the  stationary  merger  of  Cl.  The  stationary 
merger  is  a  function  of  the  scheme  CL  and  the  shift  distribution; 
different  shift  distributions  in  general  give  rise  to  different 
stationary  mergers.  It  is  proved  that  schemes  <^and  ^ are 
equivalent  with  respect  to  a  given  shift  distribution  if 
and  only  if  their  stationary  mergers  are  equivalent  with 
respect  to  the  empty  distribution.  The  basic  fl"  fTTj 
idea  of  the  proof  is  as  follows:  Consider  a  scheme  (2 
with  a  shift  distribution  B  and  the  value  V  of  CL  for  some 
admissible  sequence.  By  examination  of  all  the  various 
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possibilities  allowed  by  the  set  B^  associated  with  operator 

and  the  introduction  of  auxiliary  variables, ,  <2i.  transformed 
into  a  scheme  such  that  if  A^  is  satisfied,  that  is,  if 

A^  is  executed  for  some  given  sequence  of  assignments,  then 
A^  will  be  satisfied  in  for  some  stationary  sequence. 

By  definition  of  one  can  find  an  admissible  sequence  of 

assignments  for  which  A^  is  satisfied  in  (X\  that  is,  all 
possible  variation  in  the  logical  variables  that  would 
enable  A^  to  be  satisfied  in  CL  have  been  built  into  the 
definition  of  so  that  we  can  find  a  sequence  of 

assignments  such  that  A^  is  satisfied  in  CL  for  this  sequence. 
This  holds  for  each  operator  A^,  and  hence  for  each  value  V 

of  d . 

For  our  purposes,  it  suffices  to  present  the  definition 
of  a  stationary  merger  aw>  of  scheme  CL  for  a  given  distribu¬ 
tion  B. 

Let  E  be  an  elementary  expression,  that  is,  a  logical 
condition  or  an  operator,  in  scheme  •••,  Pk,  A^,  ..., 


A  ). 
n 


Let 


k?  /  \ 

WV  JO  otherwise 


1  if  E  is  executed  in  CC  for  the 
sequence  Ag,  Ag,  Ag, 


and  af  =  max  A?  (P]_*  1?2 ! 


B. 

l 


1(0) 


Pk)>  i  =  1,  2, 


Then 


<a(1)  = 


qxv  a1 


| _  •  ■  •  v  an  l _  j  Pk>  A^  5  '  *  '  ’  ^n  -J  ^ 


Jl 


'n 
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Suppose 


the  functions  cxY^i  —  1,  2,  n,  and  the 


v— th  merger  of  Q,  have  been  defined. 

Then  aV+1  max  (v)^  ^1’  '  ‘  '  ,pk,ql'  '  '  '  ,qn^  ’ 

Bi,q1Jq2^  •  •  •  >% 

i=l,  2, . . . ,n. 

fl(v+1)  ■  q^^r1  L  •••  %v“n+1  Ua(Pr  Pk’  Ai  J- 


Ji 


Ji 


....  An  J). 

-*n 

v  v+1 

It  is  clear  that  for  i  =  1,  2,  .  n  and  all  v,  cu  -  cu 
so  a  natural  number  p  is  arrived  at  such  that  ^  h  for 


i  =  lj  2j  n.  The  stationary  merger 

defined  as  follows: 


&(v)  of  a±< 


^  ■  ,r  ma*,  %AHa  ^>)(Pl< 


qr,  •  •  •  >  qn) 


A” 

i 


so  A"  =  max  A.'  , 

1  i  B. 

i 


and 


'  qiVAi  L  •••  qn^A;’  l_a(Pl,  ....  pk,  al  j  Ar  J) 

Jl  Jn  j  1  Jn 


As  mentioned  before ,  to  say  schemes  CL  and are  equiv¬ 
alent  for  a  shift  distribution  B  is  to  say  that  they  produce 
the  same  sequence  of  operations  for  all  admissible  inputs  and 
all  interpretations  of  the  operator  symbols .  The  area  for 
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possible  variation  in  equivalent  schemes,  then,  is  in  the 

form  of  the  logical  variables.  The  question  arises  of  having 

an  effective  method  for  generating  all  schemes  equivalent  to 

given  scheme  d  relative  to  some  distribution  B.  Accordingly, 

Yanov  supplies  a  list  of  eleven  transformations  such  that  if 

CL  is  equivalent  to  $  for  some  distribution,  then  Ct  =  $  can 

be  derived  by  use  of  the  transformation  calculus.  In  other 

words,  the  list  of  transformations  is  complete  with  respect  to 

the  property  of  equivalence  of  schemes.  The  place  of  the 

shift  distribution  in  the  situation  is  taken  into  account  by 

the  concept  of  subordination  of  an  elementary  expression  E  to 

a  logical  function  a(E  <  a).  First,  given  scheme  CL{ p-^  P2* 

. . . ,  p  ,  A, ,  . . . ,  A  )  with  shift  distribution  B,  define 
3  1  n 

E'  =  max  E®  ,  where  CL^  is  the  stationary 


qi»q2»  •  •  •  >% 

merger  of  CL  relative  to  B.  E  is  said  to  be  subordinate 
to  ct(Pl,  p2,  ...,  pk)  if  E'  ->  a  is  a  tautology.  Thus,  if 
a  fails  to  hold  for  a  given  sequence  of  arguments,  the 
expression  E  is  not  executed  for  this  sequence  of  assignments. 

In  presenting  the  list  of  transformations  some  stip¬ 
ulations  are  in  order.  The  letter  "A”  stands  for  an  arbitrary 
operator,  and  Mln  and  "0"  denote  the  true  and  false  proposition, 
respectively.  In  expressions  C(CV)  in  which  occurs,  if 
CL  =  !^the  operation  of  substitution  of  LC  for  CL  in  C(&)  giving 
C(d)  is  defined,  provided  no  confusion  results;  that  is, 
provided  there  results  no  duplication  of  indices  of  right 
(left)  brackets  and  no  duplication  of  operators.  Under 
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interpretation,  this  includes  the  fact  that  if  (X  =  ^ 
and  C  (d.)  is  a  scheme,  then  C(6)  is  a  scheme  and  C (£L)  =  C  ($) . 
The  list  is: 

1.1.  0  L  A  J  =  0  I _ I  • 

i  i  "  " 

2.  i  [_ClJ  =  Cl  . 


1  1 


X  1 


3.  J  d  1  L  =  ^  • 


II. 1.  exp  [_d  J  =  L  P  L<2J  J  . 
i  i  i  j  i  J 

2.  Jfiap  L  =  J  J(Z  L  P  L  • 

i  i  i  j  i  j 

3.  avp  L  =  H  L  P  L_  _J  • 

=  o  1 _ |  p  0  LJ  CL  0  | _ 1  . 

i  j  k  i  j  k 

J  J  =  J  J  • 

i  j  J  1 

a  L  J  =  A,  where  A  is  the  null  expression. 

a  \_CL  _J  a  L^J  =  a  “  L  J  • 
i  1  J  J  1  J  j  i 

a  L^J^J  a  L  =  a  L^J  J  ^  a  L  • 

ij  i  j  iji  j 

3.  =  [_  ©  a  L  • 

j  ii  jji  -b?  3 

4.  J  a  |_  #  a  [__#_[  =  a[_&a|_^JJ  * 

i  j  3.  j  j  i  j  i 

5.  Ja[./2  J^aL  =  aL^JJ^aL' 

i  j  J  .  1  3  3  1  .  4 

6.  _ \  Q- _ 1  a  L_  aL_  =  _J_J  CL  al _  ^ 

j  1  3  1  3  i  j 

J  a  L  ^  J  a  L  =  a  L  _1  a  L  • 

i  i  j  j  i  i  j  j 

b  a  =  p 

j-^(a)  =  Ol® 7  ‘ 


hi. 

iv. 

v . 

VI.  1 
2 


VII 


VIII. 


l 

a  | _  . 

i 


IX. 


b  d=  £  ,  hC(ff)  -  D 
b  CO©  =  D 
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X.  The  pair  \__^}  _ |  of  half— brackets  occurring  in  an 

i  i 

expression  may  be  replaced  by  the  pair  [_,  _ \  ,  provided 

j  3 

no  interference  of  half— brackets  results. 

XI.  If  a  is  subordinated  to  for  a  given  shift 
1 

distribution,  then  a  | _  may  be  replaced  by  | _ . 

i  i 

The  proof  of  the  completeness  of  the  system  of  trans¬ 
formations  proceeds  by  transforming  a  linear  scheme  into  a 
canonical  form  of  the  same.  Equivalent  schemes  are  trans¬ 
formed  into  the  same  canonical  form.  We  confine  ourselves 
to  presenting  the  definition  of  the  canonical  form  of  a 
scheme  CL  relative  to  a  given  distribution. 

Given  (2  ,  we  put  Cl  ^  =  <^, 

C[±  -  Ai  L  Ao  ^(Pi>  P2»  *  •  •  »  pk5  Al’  A2 ’  •  •  •  >  Ai  J  ’  '  •  • 

s  s 

i  =  1,  2,  .. 

where  Aq  is  an  operator  distinct  from  each  of  Ap  A2,  .. 
For  i  =  0,  1,  ...,  n  and  j  =  1,  2,  . . . ,  n  we  define 


,  A  ), 

}  n'  5 


,  A  . 
’  n 


a.  .  (A  )  = 
ij  s' 


1  if  A.  is  the  first  operator  of  the  value  of  s 
A  3 

2.  for  sequence  A  ,  A  ,  ...,  A  ,  •  •*, 

0  otherwise; 


a.  ,  • ,  (A  )  = 

i,n+l  v  s' 


1  if  the  value  of  Ck.  for  the  sequence  As,  As, 


. . . ,  Ag  is  an  empty  period, 
0  otherwise; 


1  if  the  value  of  0-.  for  the  sequence  A  , 


a. 


i,n+2 


Ag,  fig,  is  null, 


0  otherwise . 
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The  functions  a.^  are  variants  of  equivalent  schemes, 

and  conversely,  if  for  schemes  (X(p1,  P2,  •••»  P^’  Al’  An^ 

and  ^>(p-|  ,  P2,  •••5  P^’  Al’  A2’  *’*’  An^  ftij  ~  ^or 

i  =  0,  1,  .  ..,  n  and  j  =1,  2,  n  +  1,  n  +2 ,  then 

a  =a 

The  canonical  form  of  the  scheme  £Z  is 


d*  H  a 


01 


J 

02 


L 


si  A2 


a 


On +2 


L  _1  •  •  •  _J  Aian  L_  •  ■  • 

On +2  TTl  nl  11 


a 


J  o  L  J, 

p  r|  On+2 


A  u  1  j  ... 
”  nl  nl 

nn+2 


a 


hn+2 


L  J 

nn+2  On+1 


In +2 

•  J 

nn+1 


The  process  of  evaluating  a  linear  scheme  P2j 

.  ..,  pk,  Ax,  Az,  An)  reveals  not  only  the  order  in 

which  the  operators  are  to  be  applied  but  also  that  in 


which  the  logical  conditions  are  to  be  satisfied.  Yet  the 
value  of  the  scheme,  for  a  given  assignment,  does  not 
include  this  information  about  the  logical  conditions. 

The  information  is  superfluous  as  far  as  knowledge  of  the 
value  of  the  schemes  is  concerned.  Accordingly,  Yanov 
gives  an  alternative  representation  of  the  logical  schemes 
of  algorithms  in  terms  of  matrices--rectangular  schemes 
that  do  not  incorporate  this  feature. 

He  again  starts  with  logical  variables  p-^,  p2,  •  •  •  .>  Pk 

and  operators  A^,  A2,  •  ■  •  *  An  ‘  aij  ^  =  ^  ’  •••j 

n,  j  =  1,  2,  ...,  n)  be  any  logical  functions  such  that 

a. . (A  )  =  1  and  a.  (A  )  =  0  for  m  £  j  if  application  of 
ij  x  s  lm  s 
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operator  Aj  for  assignment  Ag  is  to  follow  application  of 
operator  Ai-  This  condition  is  satisfied,  for  example, 
by  the  functions  ct^_.  introduced  above  for  linear  schemes. 

The  process  of  operation  of  a  matrix  is  again  defined 
inductively.  Suppose  we  are  given  a  matrix 


where  Aq  stands  for  an  empty  "start"  operator,  and  an 

assignment  A  ,  A  ,  . . . ,  A  ,  .... 

S1  s2  m 

Step  1  Examine  the  values  of  an  (A„  )  an^  write  down 

j  S1 

some  A.  for  which  an.  (aq  )  =1. 

if  ui1  s1 

Suppose  that  m  steps  have  been  performed  and  that  at 


step  m  operator  A.  has  been  written  down. 

1m 

Step  m  +  1  Examine  the  im~th  row  of  the  matrix  and  write 
down  an  operator  A^ 


for  which  a.  .  (A  )=  1-  The 
Lm-Hl  m  m+1  ^m+1 

procedure  terminates  if  all  members  of  the  row  under  examina¬ 


tion  are  0.  The  sequence  A.  ,  A.  ,  . . . ,  A.  ,  ...  of  operators 

11  x2 


m 


written  down  is  a  value  of  the  matrix  for  the  assignment 


A  ,  A  ,  ■  •  •  ,  A  , 
S1  s2  sm 


As  in  the  case  of  linear  schemes  a  shift  distribution 
B  delimits  certain  sequences  of  assignments  as  admis sible 
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if  among  the  values  of  (X-  for  this  sequence  there  is  one  A.^, 

=  A  or 
s_ 


A  ,  ....  A.  ,  ...  such  that  for  each  m,  A 

1-  sm+l 


m 


l~  m 

A  z  differs  from  A  in  values  of  variables  belonging 
sm+l  ^Sm 

defines  a  matrix 


mix 

to  B.  .  A  matrix  A£(p-^, 
m 


Pk} 


scheme  relative  to  a  given  shift  distribution  B  if  for  each 
admissible  sequence  the  associated  value  of  0-  is  unique. 

The  equivalence  of  matrix  schemes  is  defined  just  as 
for  linear  schemes ,  and  it  is  proved  that  the  problem  of 
deciding  whether  two  schemes  are  equivalent  with  respect 
to  a  given  shift  distribution  is  solvable. 

For  matrix  schemes,  the  problem  of  designating  those 
transformations  that  are  complete  relative  to  equivalence 
has  a  nice  solution.  By  a  transformation  we  mean  a 
mapping  such  that  cp  -  (n  (a)  =  a)  is  a  tautology.  By  a 

n1  transformation  of  the  matrix  Q_=  |  ct .  .  we  mean  the 

cp  i 

replacement  of  an  arbitrary  element  ct^  of  its  i-th  row  with 

the  function  a!.  =  n  (a..).  Yanov  proves  that  all  n*n  trans— 
i]  CP  1J  Ai 

formations  take  matrix  scheme  <^into  equivalent  scheme  and  that 
any  scheme  'iB  equivalent  to  given  scheme  O.  can  be  obtained  fr 
Q-  by  a  transformation  and  the  addition  or  deletion 

l 

of  zero  rows  or  columns. 

A  few  words  about  equivalent  MS  (matrix  schemes)  and 
LS  (linear  schemes)  are  in  order.  In  this  connection,  some 


om 


auxiliary  concepts  must  be  introduced.  A  matrix  0-=  A^ 

m 

is  called  complete  if  for  i  =  0,  1,  •  ..,  n,  AV  -*  \J  cu. 

j=l 

is  a  tautology.  A  set  {ck}  of  logical  functions  is  said  to 
be  orthogonal  if  m  =0  for  i  ^  j  •  A  matrix  0-  is 


a.  . 
ij 
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orthogonal  if  each  row  is  an  orthogonal  set.  A  complete 
orthogonal  matrix  is  said  to  be  normal .  Of  coursej  each 
orthogonal  matrix  is  a  matrix  scheme  for  any  shift 

one  can 


a 


ir 


distribution ,  and  given  an  MS 

obtain  an  orthogonal  MS  equivalent  to  Q- ,  namely, 

yS  =  A.  1  ('A'.’* a.  .  )  ;  'S  is  said  to  be  a  reduced  form  of  CL  • 
i 1  v  i  ij  '  5  - 

To  establish  a  correspondence  between  linear  and  matrix 
schemes,  it  is  necessary  to  add  to  the  columns  of  a  matrix 
two  marked  "(  )"  and  designating  the  empty  period  and  the 

termination  of  the  procedure,  respectively.  Given  MS 


H  A. 

CL.  . 

1  1 

A1 

A2 

A 

_ n _ 

• 

A0 

a01 

a02 

“On 

“On+1 

A1 

“ll 

a12 

“in 

“ln+1 

<*>  : 

An 

°nl 

an2 

a 

nn 

“nn+1 

where  °ln+1  - 

n 

=  A  a. . , 
1-1  1J 

is  complete 

and  e 

quivalent  to  Cl  for 

—> 

any  shift  distribution 

Note  also 

that 

a  reduced  complete 

MS  is  normal. 

.  As  the 

reader  doubtlessly 

anticipates,'  MS 

CX  =  a7~ [~ aTT  and  LS  Cl  (p^,  P2^  •  •  •  >  A2,  •  •  •  ^  An) 

are  equivalent  for  a  given  shift  distribution  if  for  all 


admissible  sequences  of  assignments  their  values  are  coincident. 
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We  recall  now  the  functions  and  schemes  0- ^ 

defined  earlier  in  connection  with  the  derivation  of  the 
canonical  form  of  a  linear  scheme  which  came  up  in  dis¬ 
cussing  Yanov 1  s  completeness  proof.  If  we  replace  the 

A 

schemes  G .  by  the  schemes  0-1  =  0  I  U(Ai  j  •  •  *  A-  — i  > 

l  'L  l  i 

A  ) ,  and  the  functions  «!.  are  defined,  related  tod! 

'  ’  '  J  n  A  1 

as  the  a„  are  to  Q±,  it  is  not  hard  to  verify  that  the 
scheme  A.  |  ad  will  be  equivalent  to  the  scheme  CL  for  any 
shift  distribution. 


Contrariwise,  suppose  that  a  matrix  of  the  form  (*) 
is  given,  and  that  for  a  given  shift  distribution,  this 
matrix  is  a  complete  MS.  The  linear  scheme 


l0n+2 


L  J  •••  J 

On +2  Ul  nl 


Alall 


ln+2 


L  J  ...  J  A2  ...  An  “nlL  ...  ann+2  L  J 

ln+2  02  n2  nl  nn+2  On+1 

J  JO  L  J  •••  J 

nn+1  r\  r\  On+2  nn+2 


is  equivalent  to  the  MS  for  the  given  shift  distribution. 
For  example,  consider  the  following  MS  with  the  universal 
shift  distribution 


A1 

A2 

(  ) 

• 

Ao 

pl 

pl 

0 

0 

A1 

0 

pl 

0 

pl 

P1  p2 

P1  ’  p2 

0 

p2 
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The  scheme  CL  equivalent  to  it  is 

P]_  1 _ I _ I  JAiPlLJil _ I  J  jA2P1Vp2LPiVP2LP2l _ I  J> 

1215  34263  5  6774 

where  the  left  brackets  have  been  indexed  consecutively  from 
the  left,  and  all  occurrences  of  the  function  1  have  been 
deleted . 

This  scheme  can  be  transformed: 

0~  =  Pxl _ 1  A1p1 1 _ 1  l A2?2  L-Pi  l _ l?2  I — Pli _ 1  -J 

25  226  7  57  8684 

=  JPlLAiPil _ 1  i  a2P2  I — -Pi  1 — ?1 1 - 1  J 

5  2  421  75674 

=  J  tpL  1 Ai^P 1 1 _ 1a2P2L?iL01 _ l  J 

56  2  42  75674 

=  JPlLAiFil _ I  a2P2  L?i  I _ l°l _ 1  -1 

6  2  42  755674 

=  JP]_aiPiLLp2  l _ 1* 

6  4  2  6  4 

In  a  computer  program,  for  various  reasons,  the  same 
group  of  instructions  may  appear  at  different  locations  of 
the  program.  To  reflect  this  situation,  it  is  natural  to 
consider  logical  schemes  that  contain  repetitions  of  the 
operators.  This  can  be  denoted  by  retaining  the  same 
symbolism  and  adding  a  relation  of  the  form  A-^  =  .  More 

generally,  let  there  be  given  linear  schemes  P2,  •••> 
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Pk-’  Al’  A2’  ’’  An^  and  ^P1J  pk*  A1J  '  '  '  J  An^» 

together  with  t  defining  relations  R, (A. ’ ,  A.',  A.  '), 

^  “•  “  2  ^ 

R9(A  2  A. 2 ,  .  .  .,  A.  2),  .  ..,  R.(A  Z,  A.fc,  .  ..,  A  t),  1 

Z  X1  x2  xn2  C  11  X2  1nt 

and  consider  the  problem  of  the  equivalence  of  (2  and  'S .  In 
this  generality ,  however,  all  is  in  vain  since  the  problem 
includes  the  word  problem  for  semigroups,  which,  as  is  well 
known,  is  recursively  unsolvable.  More  special  cases  can, 
however,  be  studied.  Yanov  does  consider  the  case  in  which 
the  lone  defining  relation  is  A-^  =  A2  and  proves  that  the 
associated  equivalence  problem  is  solvable. 

Yanov 1 s  paper  constitutes  an  impressive,  finished  piece 
of  work.  The  technical  level  is  high,  and  all  questions 
considered  are  nailed  down  very  tightly.  Within  the  limits 
he  sets  up,  the  logical  domain  is  thoroughly  covered,  and 
such  care  and  completeness  are  to  be  welcomed.  It  should 
be  pointed  out,  nevertheless,  that  the  territory  covered 
invites  and  facilitates  such  a  treatment.  The  mathematical 


problems  are  easily  identified  and  quite  "doable." 

The  definition  of  equivalence  employed  Is  surely  too 
strong  to  be  of  much  practical  value.  It  seems  right  that 
two  computer  programs  could  be  judged  to  be  very  alike,  and 
hence  "equivalent,"  without  prescribing  the  same  sequence  of 
r  computations  for  all  allowable  inputs  in  some  well-defined 
context.  They  could  conceivably  be  required  to  agree  only  in 
the  significant  or  "major"  intermediate  calculations.  Of 
course,  this  is  the  delicate  point.  What  and  how  much  is  to 
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be  regarded  as  major?  How  much  can  things  be  disturbed 
in  various  directions  without  making  the  problem  unsolvable? 

Rutledge  [31]  extends  some  of  Yanov's  notions,  and 
casts  the  theory  in  the  guise  of  finite  automata;  that  is, 
a  scheme  becomes  a  sextuple  consisting  of  sets  of  operators, 
predicates,  state  functions,  and  the  like.  It  represents 
an  abstraction  from  the  concrete  peculiarities  of  Yanov's 
schemes.  Rutledge  also  jsolves  the  equivalence  problem 
by  making  use  of  canonical  forms.  He  shows  how  to  associate 
with  each  scheme  a  finite  automaton,  and  by  having  his 
output  function  be  a  strictly  into  mapping  of  the  set  A 
of  operators  into  itself,  he  arrives  at  a  solution  of  the 
equivalence  problem  for  the  case  in  which  certain  operators 
are  identified. 

On  the  other  hand,  Rutledge's  format  is  rather 
skeletal  compared  to  Yanov's.  It  is  certainly  of  value 
in  characterizing  exactly  the  mathematics  involved,  that 
is,  as  a  part  of  the  theory  of  finite  automata,  but  it 
leaves  an  inexperienced  reader  with  a  feeling  of  incomplete¬ 
ness.  The  schemes  of  Yanov  are  symbolically  more  similar 
to  computer  programs,  and  hence  are  more  suitable  for 
performing  the  calculations  that  mirror  those  which  come 
up  in  actual  programs.  Yanov's  formalism  is  more  appro¬ 
priate  for  investigating  the  logical  transformations 
performed  on  schemes;  whereas  Rutledge's  serves  to  bring 
out  the  central  organizing  principles. 
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2.2.2.  Nonlogical  Transformations 

2.2.2. 1.  Transformations  on  the  Indices  of  Operators. 
The  question  underlying  the  developments  of  this  section  con¬ 
cerns  the  description  of  the  data  to  he  fed  into  a  computer. 
Changes  in  the  initial  description  may  be  occasioned  both  by 
the  programmed  algorithm  and  by  considerations  of  machine  storage. 
To  elaborate,  consider  an  initial  indexing,  or  parametrization 
of  the  elements  in  the  domain  of  operators  of  some  program 
scheme.  Here  the  elements  are  indexed  as  independent  units  of 
information.  The  algorithm  described  by  the  scheme  gives  rise 
to  a  second  indexing  in  -which  certain  relations  of  dependence 
are  expressed  among  the  original  parameters.  This  second 
parametrization  leads  to  a  new  program  scheme.  Finally,  the 
storage  of  the  data  of  the  problem  occasions  a  third,  operating 
parametrization ,  and  this  in  turn  gives  rise  to  the  operating 
program  scheme,  on  the  basis  of  which  the  actual  program  is  to 
be  constructed.  The  obvious  aim  is  the  development  of  procedures 
such  that,  given  scheme  ai  based  on  parametrization  P-^  and 
a  new  parametrization  P2,  one  can  construct  from  a  scheme 

&2  based  on  P2 •  In  other  words,  how  do  the  representations 
of  the  arithmetical,  control,  and  logical  operations  in  a 
program  scheme  change  when  a  new  parametrization  is  intro¬ 
duced?  This  question  is  taken  up  by  R.  I.  Podlovchenko  [28] 
and  N.  G.  Arsenteva  [2].  These  authors  actually  do  little 
more,  however,  than  provide  illustrative  examples.  Let  us 
consider  the  construction  of  the  program  scheme  describing 
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the  product  A  •  B  of  symmetric  n  x  n  matrices  A  and  B. 

In  this  case,  the  symmetry  condition  will  affect  the 
parametrization,  and  hence  the  operating  program  scheme. 
One  starts  with  the  calculation  scheme 


n  n  n 

n  n  n  a  . 

1=1  i=l  j=l 

A  program  scheme  based  on  this  calculation  scheme  is 

1,2,3  1 

J,  Ai.^F(j)f(j)p(j  >  n)tF(-nj)F(i)f  (i)  (1  -  j) 

2  3 

p  (i  >  n)t(l  -  i)F(-ni)F(^)f  (^)p(-t,  >  n)TF(-nt) 


(1  -  i)  STOP, 


where  F,  as  above,  is  a  readdressing  operator;  f(i)  symbol¬ 
izes  that  1  is  added  to  contents  of  the  location  storing 
i;  and  "a  -»  bu  means  that  a  is  stored  in  the  location, 
containing  b,  that  is,  a  displaces  b  in  this  location. 
Initially,  i  =  j  =  l  =  1  •  IfA  =  (a^j ) ,  B  =  (bj^), 

C  =  A*  B  =  (cmr),  and  A  and  B  are  symmetric,  new  parameters 
i',  j',  k',  i' ,  m',  r'  are  introduced 


i  =  p  (i  >  j  )  t  i  '  1  j  '  , 
1 

1 

j  =  P(i  >  j)fj  '-ii'  , 
1 

1 

k  =  p  (k  >  -Otk  'h  1 , 
1 


l  = 


m  = 


r  = 


p(k  >  t)t't,ik'  , 
1 

1 

p (m  >  r)fm'lr ' , 
1 

1 

p (m  >  r ) f  r 1 |m '  . 

1 
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Thus,  the  first  of  these  equations  is  to  be  interpreted  as 
stating  that  i  =  i'  when  i  >  j  and  that  otherwise  i  =  j  '  • 
The  following  relations  hold  between  the  address- 


modification  operators: 

1  2 

F(i)  =  p(i  >  j)tF(i,)UF(j,)l;  F(k) 
1  2  1  2 

(3)  <  F  (j  )  ^  P(i  >  j)tF(j)UF(i’H;  F(i) 

i  1  2 

1  2 

F  (m)  s  p(m  >  r)fF(m' )f^F(r F  (r  ) 

1  2 


1  2 

p(k  >  ^tFCk^UFa')!, 
1  21  2 

p (k  >  ^)tF(^')UF(k?)J/s 
1  2 

1  2 

p  (m  >  r)iF(r,)t|F(m,)|, 
1  2 


and  similarly  replacing  i,  j  k,  i,  m,  r,  i'j  j',  k  ,  i  ,  m  , 
r'  by  — i,  -j,  -k,  ~l,  -m,  -r,  -i ' ,  -j  ' ;  -k'*  *  -m' *  and-r', 

respectively, as  the  argument  of  the  operator  F. 

It  is  economical  to  introduce  "formation  operators"  which 
store  the  initial  form  of  an  instruction.  The  notation 
"[1  j]"  denotes  the  operator  that  sets  j  =  1  in  operators 

depending  on  j,  and  replaces  j  in  its  location  by  1. 

Noting  that  in  the  case  under  consideration  k  =  j,  m  =  i, 
r  =  l,  system  (3)  is  replaced  by 

12  3  4 

F  ( j  )  =  p  (i  >  j)tF(j,)UF(i')lp(j  >  l)tF(k,)UF(i')l, 

1  21  2  3  43  ^ 

F  (i)  =  p(i  >  j  )  f  F  (i  1  )  Uf  (j  '  )v!p  (i  >  k)fF(m,)UF(r')|, 

1  21  2  3  43  4 

FU)  =  p(j  >  t)tF(l')UF(k')J/p(i  >  t)TF(r’)UF(m')J/. 

12  3  4 
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Using  (4),  formation  operators,  and  the  fact  that  some 
logical  conditions  are  universally  true  and  others  are 
universally  false,  program  scheme  (1)  becomes 

4  5  6  7 

i  A,.  p(i  >  j)fF(j')flF(i')^P(j  >  t)TF(k')UF(t')|f(j) 
1,2,3  ±31  4  5  6  7 

1  8  9 

p(j  >  n)TU  -  j]F(i')p(i  >  ^)fF(m,)tiF(r')lf  (i)p(i  >  n) 

8  9 

2  3 

t[l  -  i  ]F  (k '  )F  (m '  )f  (^,)p  (-t  >  n)f[l  -  l]  STOP. 


It  is  assumed  that  the  elements  of  the  matrices  are 
stored  by  rows  into  successive  memory  locations,  starting  with 

all  in  al’  bll  in  blJ  and  C11  in  C1‘  Memory  parameters  s,  t, 

v  are  introduced  to  represent  the  fact  that  the  elements 

a.,.i,  b  ,  ,,  c  i  i  are  stored,  respectively,  in  locations 

ij  k  ,  i  m  ,r 


ag  =  +  (j  '  -  1)  + 

bt  =  b^  + 
cv  =  c1  +  (r '  —  1)  + 


i'Ci'  ~  1) 


1)  +  k'(k’  -A)., 


m1 (m1  —  1) 


Making  use  of  the  fact  that  in  the  case  under  con¬ 
sideration  k  =  j,  m  =  i,  r  =  t,  it  follows  that 

1 

i'  =  p (i  >  j )f i^j , 

1 
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k'  = 


m '  = 


p(j  >  -Otjli  , 

l  l 

p(i  >  • 

1 


Consequently, 

1  2 

F  (i '  )  =  p(i  >  j)fF(is)UF(js)4,  , 

1  2 

1  2 

(5)  <  F(j  ' )  =  p(j  >  l)tF(jt)UF(^t)j  , 

1  2 

1  2 

F(m')  s  p(i  >  ,t)tF(iv)UFUv)l  . 

1  2 


Substituting  in  (4),  one  obtains 


12  3  4 

F(j)  =  p (i  >  j)tF(s)t|F(js)|p(j  >  ^)TF(jt)UF(tH, 

12  3  4 

12  3  4 

F  (i)  =  p  (i  >  j)tF(is)UF(s)jp(i  >  ^)/[f  (iv)t|F  (v) 

12  3  4 

12  3  4 

F  U)  =  p(j  >  OtF(t)t|F(jtt)jp(i  >  4)TF(v)t|F(^v)j. 

12  3  4 


One  finally  arrives  at  the  following  operating  scheme, 
based  on  the  operating  parametrization ,  and  employing  the 
memory  parameters  : 

4  5  6  7 

l  AgtvPC1  >  j)TF(s)/tviF(js)|P(j  >  l)TF(jt)t 
1,2,3  4  5 
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1  8  9 

(t)^f  (j  )p  (j  >  n^Cl  -  j]F(is)p(i  >  l  )TF  (iv)ti 

6  7  8 

2  3 

F(v)jf  (i)p(i  >  n)  |  [1  -  i]F(|,t)F(tv)fU)p(t  >  n)f  [1  -  l]  STOP. 

9 

Other  examples  are  given  in  the  two  cited  papers:  The 
Leverrier  method  of  finding  the  characteristic  polynomial 
of  a  matrix,  the  solution  of  the  Dirichlet  problem  over  a 
square,  and  others. 

It  must  be  clear  to  the  reader  that  the  tone,  style, 
and  methods  of  these  papers  are  of  a  piece  with  those  of 
Lyapunov's  earlier  paper.  The  symbolism  and  methods  of 
the  papers  are  purely  descriptive,  and  they  are  written  in 
a  way  that  looks  forward  to  a  more  general,  systematic  analysis 
of  the  problem.  Podlovchenko ' s ,  On  the  Basic  Principles  of 
Programming ,  T  [27],  seemed  to  forecast  such  a  treatment, 
and  in  that  sense  his  [28]  is  disappointing.  His  [27] 
is  concerned  with  the  introduction  of  definitions  and 
terminology  that  serve  to  organize  the  data  of  programming 
into  classes  of  information,  and  with  the  systematic 
identification  of  this  information.  Chief  among  the 
notions  introduced  are  those  of  the  characteristic  of  a 
system  of  information,  the  characteristic  of  an  operator,  and 
a  ranking  of  operators.  The  characteristic  of  a  system  of 
information  is  the  set  of  parameters  indexing  the  elements 
of  the  set.  In  the  above  example.  A,  B,  and  C  constitute 
a  system  of  information  and  [i,  j,  k,  1,  m,  r]  is  the  char¬ 
acteristic  of  this  system,  with  {i,  j]  being  the  characteristic 
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of  A ,  etc.  When  restrictions  are  placed  on  some  of  the 
parameters  of  a  parameterized  system  of  information  we 
arrive  at  a  subcharacteristic  of  this  system;  {i,  j,  k} 
is  a  subcharacteristic  of  A,  B,  C.  The  argument  and  value 
of  an  operator  symbolizing  some  operation  on  an  information 
class  are  called  its  input  and  output,  respectively.  A 
subcharacteristic  of  the  input  determines  a  characteristic 
of  the  operator;  in  the  above  [i,  j,  i }  is  a  characteristic 
of  operator  A. .  • 

Suppose  we  have  an  operator  A.  .  with  character— 

1 '  n 

istic  {i-^,  .  ..,  in}  and  i-^  assumes  some  one  of  s  allowable 

values.  The  resulting  operator  depends  on  in] 

and  there  are  s  such  operators.  The  logical  product 

B .  •  •  of  these  s  operators  is  said  to  be  an  operator 

12  3‘  *  n 

of  the  first  rank  relative  to  ^i  . . • in •  Operators  of 

higher  rank  relative  to  A.  .  ^  are  defined  recursively. 

1  n 

Thus,  an  operator  of  the  n-th  rank  relative  to  A.  ^ 

11‘  '  n 

is  independent  of  parameters. 

In  short,  while  [27]  seems  to  make  a  beginning  for 
a  formal  treatment  of  transformations  on  indices  in  schemes, 
[28],  for  the  most  part,  merely  catalogues  examples. 

2. 2. 2. 2.  An  Example.  The  transformations  of 
program  schemes  by  means  of  changes  in  the  indices  of  the 
operators  bear  on  several  special  classes  of  problems,  such  as 
those  in  which  some  iterative  procedure  is  applied  in  some 
definite  order  to  each  of  the  arguments  of  some  function  of 
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several  variables,  and  those  which  involve  branching  processes. 
An  illustration  of  the  former  is  the  calculation  of  the 
partial  derivative  of  a  function  fCx-^,  xp)  of  p  variables 


(1)  (2) 

given  values  x-£  '  ,  x ^  , 


x(Vl>  x(1) 
x  ,  x2 


.  (v2> 


x 


x 


of  the  arguments  and  hence  v^-v2  •••  Vp 


(1) 

P  1  ' ‘ *  "p 

function  values.  Suppose  we  wish  to  compute  (approximately) 


1^2),  where  x  =  (x^,  x2*  -  xp)  and  that  x^1^  <  xk<'mk+1^) 


and  there  is  a  positive  integer  N  such  that  +  N  < 
k  =  lj  2,  .  ..,  p.  The  value  of  f  at  x  is  computed  by  success¬ 
ive  polynomial  interpolation,  and  thence  the  partial  derivative 
of  f  with  respect  to  xp  at  x  is  calculated.  Suppose  it  is 
desired  to  compute  the  partial  derivative  of  f  at  x  with 
respect  to  each  of  the  other  coordinates.  A  calculation 
scheme  can  be  written  sketching  the  procedure  for  calculating 
the  partial  derivatives  of  f  at  x;  if  these  schemes  are 
arranged  in  some  definite  order,  then  each  can  be  obtained 
from  the  preceding  one  by  a  "circular  substitution  of  the 
subscripts."  The  objective  is  the  construction  of  a 
program  scheme  that  includes  the  algorithm  prescribed  by 
the  succession  of  calculation  schemes.  To  illustrate,  let 

p  =  3  and  let  A.  .  .  be  some  operator  such  that  the  memory 

131211 

cell  on  which  A.  .  .  acts  depends  on  i3,  T-2’  H  according 

131211 

to  some  rule  ^(i^,  i 2 >  ip)-  For  instance,  we  might  have 
4  (ig,  ‘*"1^  =  r3^"3  r2^2  rl^l  ’ 
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where  r^,  and  are  positive  integers.  Thus,  if  we 

start  at  some  memory  cell  a,  A.  .  .  is  applied  to  the 

1312  1 

contents  of  the  cell  cc  +  r^i^  +  r2^2  rl:*‘l' 

We  start  from  the  schemes 


-47- 


increased  by  one;  and  F(m,  i)  means  that  m  is  added  to  the 
parameter  i.  Also  T  designates  the  contents  of  the  cell  6. 
The  memory  parameter  t  is  introduced  via  the  equations 


a  +  «Ki3,  ±2’  =  a  + 

a  +  m2,  m^)  =  a  +  tg, 

where  ^(i3,  ^2}  ^1^  ~  r3^"3  +  r2^2  +  r  1^  1  * 

We  write  \  for  A^^  and  A^  for 

Taking  into  account  the  changes  occasioned  in 
address  substitution  operators,  the  above  scheme  is 
formed  into 


the 

trans— 


3  2  1 
(At  -  At)(m3  -  63>|(m2  -  S2H(mi  ”*  6iHAt 

F(rx,  t)f(l,61)u('61  >  n1)fF(-(n1  -  m^r^  t)F(r2,  t)f(l,  &2) 

1 

U(62  >  n2)tF(-(n2  -  m2)r2 ,  t )F  (r3 ,  t )f  (1 , 63)^  >  n3)f  STOP. 

2  3 


To  achieve  symmetry  of  representation,  zero  is  represented 

by  each  of  ng,  mg,  rg,  and  successive  address  substitution 

operators  are  combined  to  arrive  at: 

3  2  1_ 

(At  -  At)(m3  ~  63)|(m2  "*  62H(ml  ""  6lHAt 

F(r1  -  r0(n0  -  mQ),  t)f(l,  >  n1)/[F(r2  -  r1(r>1  -  ^  }t) 

1 

f(l,62)p(T2  >  n2)fF(r3  -  r2  (n^)  ,  t)  f  (1 , 63>p  (63  >  n^f  STOP. 
"2  3 

Let  =  rk  —  rk-i^nk-l  —  mk— 1^‘  This  enables  one  to  write 
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3  °_  0 
(At„  -  V  ^0{(ms  -  6s)HAtF(art),L{\  "*  V} 


-t=o 


0 


f(l,61)n(6i  >  n1)/[F(a2,t)  n  {  (m^  -  6^)}  f  (].,  62)n(62  >  n2^ 
„  l~°  0 


F(a3,t)  (m^  -  6^)}f  (1^3)^C5’3  >  n3)f  STOP. 


It  is  to  be  understood  that  the  numbers  ak  are  stored 
in  cells  the  mk  in  Pk,  and  the  nk  in  We  put 


k— 1 


§k =  F^k^t}  n  {(Fi  V^'V^k  >  pk^- 

1=0  0 


With  this  abbreviation ,  the  above  scheme  becomes 


(*)  -  V  \  l(f3s  -  VHVibb  ST0P' 

0  s=l 


By  expansion  of  the  products ,  this  can  be  rearranged  to 
become 

_  3  °_  } 

(A  -  A  )  n  {(p;  -  6s)}|At(l  -  Yk)($l.  “*  VK 
0  s=l 

F(l,k)f(l,Yk)n(Yk  >  3)1  STOP, 

1 

where  the  operator  (1^  -»  $k)  is  construed  as  the  execution 
of  the  following  three  operators: 

[F (Hpt)  -  F(Hk,t)], 

{f  (1, 63^)  -  f(l,6k)}, 

luC*.  >  nx)f  -  p(\  >  nk)f}. 

0  0 
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The  consecutive  execution  of  calculation  schemes  (1),  (2), 

and  (3)  then  is  prescribed  by  the  following  program  scheme: 

Jj0  l(av  -  “v)(%  -  Pv>(nv  “  pv)]  "  6a)(Py  ■"  V' 

<P"  -  e  .,)  n  (  (3t_i  -  -  pp  (?;'_!  -  PP 

y  h  1=3 

~  “i^V  -  4)<V’  -  PiO/Z(3)}  STOP, 

where  6  .  0R  t ,  and  6ftn  are  "working  cells,"  that  is,  cells 
in  which  intermediate  calculations  are  carried  out  and  CL 
stands  for  the  programming  scheme  (*)• 
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2.3.  An  Abstract  Formulation 

R.  I.  Podlovchenko ' s  "On  the  Transformations  of  Program 
Schemes  and  Their  Applications  to  Programming"  [29],  seems 
to  mark  the  first  abstract  treatment  of  the  Lyapunov  operator 
method  of  programming.  It  is  wise  to  consider  it  separately 
since  its  subject  is  the  systematization  and  abstract  treat¬ 
ment  of  the  notions  introduced  in  the  more  concrete,  special 
instances  described  above.  Other  papers  on  which  we  shall 
comment  are  conveniently  suited  to  a  more  common  treatment 
in  that  they  introduce  or  develop  notions  absent  or  scarcely 
present  in  the  more  practical  papers. 

This  paper  occupies  a  pivotal  position  in  the  develop¬ 
ment  of  the  theory.  It  presents  a  connected  series  of 
concepts  which  represent  an  abstraction  from  the  notions 
introduced  in  the  earlier,  problem-oriented  papers,  but  which, 
at  the  same  time,  are  directly  and  easily  reducible  to 
these  notions.  The  paper  thus  serves  to  unify  the  contents 
of  the  papers  described  previously,  and  provides  the  reader 
with  a  rigorous,  convenient  source  of  the  basic  topics 
scattered  among  them. 

On  the  other  hand,  the  possibility  of  defining  a  fruit¬ 
ful  algebraic  structure  on  the  classes  of  objects  considered 
by  Podlovchenko  is  not  pursued.  The  theoretical  development 
remains  therefore  on  the  level  of  mere  systematization  of 
and  generalization  from  concrete  instances  of  program 
schemes.  The  concepts  are  not  related  to  those  of  any 
established  branch  of  algebra,  and  hence  the  possibility 
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of  pursuing,  by  analogy,  suggested  directions  of  research 
as  well  as  use  of  the  battery  of  techniques  provided  by 
such  disciplines  are  foregone.  Podlovchenko ' s  paper  thus 
appears  as  transitional,  summing  up  the  basic  notions  so 
far  introduced,  and  keeping  manageable  the  distance  between 
abstract  concept  and  particular  example. 

2.3.1.  Basic  Definitions.  By  a  memory  is  meant  a 
set  Z  =  { z }  of  objects  whose  members  are  called  cells . 
Consider  a  set  G  =  {x}  of  states  and  a  set  Y  of  mappings 
called  states  of  the  memory,  or  memory  states,  of  Z  into  G- 
An  operator  is  a  function  with  domain  Y  and  range  a  subset 
of  Y.  By  a  predicate  over  the  memory— states  is  meant  a 
function  p  defined  on  Y  and  taking  values  in  the  set  {0,1}. 
By  the  product  (composition)  A-j^  •  A2  of  the  operators  A^  and 
A2  is  meant  the  operator  A  =  A2(A1(X)),  XeY.  The  operator 

(  AX(X)  if  pn(X)  =  1, 

A (X)  =  < 

|  A2 (X)  if  p^ (X)  =  0 
is  called  conditional . 

If  d  is  some  set  of  operators  and  t  is  a  set  of 
predicates  over  the  memory— states  (hereafter  for  brevity 
the  members  of ^ are  called  simply  predicates),  then  we 
consider  the  smallest  superset  Q.g  of  ^  which  is  closed 
under  composition  and  forming  the  conditional  of  two 
operators  with  respect  to  some  predicate  pnc  $ . 
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It  is  clear  that  the  members  of  constitute  the  main 

ingredients  out  of  which  program  schemes  are  made.  Podlovchenko 
accordingly  introduces  his  definition  of  a  scheme  with  a  view 
toward  representing  members  of  °-8  ■ 


By  a  logical  condition  is  meant  any  member  of  the  set 

V-0  =  CX) ,  t)],  where  p^e  ^  and  ^  is  a  natural  number. 

Logical  conditions  (p^  (X) ,  i ^  and  (p^Cx),  i2)  are  said  to 

be  equal  if  p„  =  p„  and  ti  =  lo  •  A  function  mapping 

— -  ^1  l2  x  ^ 

into  itself  is  said  to  be  a  formulator .  Let 

f  =  t*p  }  be  some  set  of  formulator s  fixed  in  the  sequel. 

A  functor  is  an  element  of  the  set  =  { (Sp,  m)}  of 

ordered  triples.,  where  $  and  i  and  m  are  natural 

numbers.  The  definition  of  equality  of  functors  is  obvious- 

The  interpretation  of  an  occurrence  of  a  functor  ($,t,m) 

in  a  scheme  is  as  follows :  t  defines  that  element  of  the 


scheme  that  serves  as  an  argument  of  the  function  §,  and 
the  value  of  5  for  this  argument  is  that  element  of  the 
scheme  defined  by  the  number  m. 

Let  B(t,  X)  be  a  function  from  N  x  Y,  where  N  is  the 
set  of  natural  numbers,  into  $U UW^,  which  for  t  =  0  is 
independent  of  X.  Consider  a  sequence  of  such  functions: 


Mn  5  S ( t , X ) 

=  B°(t,X)5B1(t,X)j . ..,Bn(T,X),Bn+1(T.X),. . . ,Bn+S(r,X). 
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It  is  such  a  sequence,  with  suitable  restrictions, 
that  is  to  serve  as  a  scheme.  It  is  necessary  to  define 
how  to  make  a  sequence  Mn’s(T,x)  "go,"  and  in  this  connec¬ 
tion  to  define  its  admissible  applications.  Given  a  pair 
(t  ,Xq)  ,  then  a  triple  X(t,Xq),  Mtq.Xq),  Mn’S(T0,X0), 
where  X(Tq,Xq)  is  a  memory— state  and  k(Tg,XQ)  is  a  non- 
negative  integer,  is  said  to  be  admissible  if 

(a)  0  <  k(T q^Xq)  <  n  ; 

(b)  Bk  (T0  >xo)  (Tq,Xq)  is  not  a  functor,  or  Bk^T0'X(P  = 
(1,1,111),  where  0  <  1,  m  <  n  +  s,  and  B^CTqjXq)  i  . 

It  is  necessary  to  give  the  rule  0  of  succession  for 
admissible  triples.  0  is  defined  by  stating  how  to  proceed 
from  an  admissible  triple  X(Tq,Xq,  k(T q,Xq) ,  MnjS(TQ,XQ)  to 
a  next  admissible  triple  X(Tq  +  1,Xq),  k(T^  +  1,Xq), 

M^s(t0  +  1,Xq),  as  follows: 

!A(X(t0,X0))  if  Bk(TOxo)(T0,x0)  =  A  €#., 

X(Tq,Xq)  otherwise; 

!l  if  Bk(T0^X0)(T()^x0)  =  (p(X),t)  6 
and  p(X(TQ,X0))  =  0  , 

k (t q , Xq )  otherwise  ; 
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Mn^S(T0JX0)[f  (B^(T0,X0)  -  m]  if 

Bk(TCPX0)  (t0,X0)  =  [i,l, m)  €  W, 

Mn’S(T03X0)  otherwise, 
where  Mn  ’  s  (Tq .Xq)  [  $  (B^(t q.Xq)  )  -*  m]  is  the  sequence  obtained 
from  M11^ s  (Tq,Xq)  by  substitution  of  I  (B'f  '(Tq.Xq))  e  AUV^> 
for  the  m-th  element  of  the  sequence  *  S  (tq.>Xq)  • 

It  is  natural  to  call  a  triple  final .  or  concluding.  if 
application  of  9  to  this  triple  results  in  an  inadmissible 
triple.  Thus  X(tq.Xq).  k(T0,X0),  Mn,s(T0,X0)  is  final  if 


(c)  M  ,s(t 


0 


+  1,XQ)  = 


or 


or 


(a)  ^Tq.Xq)  =  n,  and  Bn  (Tq .Xq)  is  an  operator  or  functor 

00  k(TQ,X0)  =  n.  Bn  (t q jXq)  =  (Pn(X),tk),  and 
pn(X(T0,X0))  =  1; 

(c)  0  <  k (t 0 , XQ )  =  kQ  <  n;  B^Tq.Xq)  =  (pk0 (X) . fk°)  ,  and 

pk0(X(T0,x0))  =  0.^0  >  n • 


The  function  6  obviously  successively  generates  triples, 
and  to  get  started  one  sets  X(O.Xq)  =  Xq  for  Xq  e  Y  and 
k(0,XQ)  =  0.  Consider  now  a  sequence  of  triples 


x(0,x0) 

k(0,XQ) 

Mn’s(03X0) 


x(i.xt),  .... 

k(l.XQ).  .... 
Mn's(l,X0),  .... 


X(V, Xq)  .  ...  M 

k(v,XQ).  ...« 
Mn's(v,X0).  ... 
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A  memory— state  Xq  is  said  to  be  M— admissible  if  there 

n  s 

is  a  concluding  triple  in  (1),  and  a  sequence  M  3  (t^X)  is 

said  to  be  a  scheme  if  there  is  at  least  one  M— admissible 
Xq  e  Y.  Thus ,  a  sequence  Mn*s(T,X)  is  a  scheme  if  for  some 
Xq  the  process  of  generating  admissible  triples  comes  to 
a  halt. 

Let  Ym  c  Y  be  the  set  of  all  M— admissible  memory- 
states.  Toward  representing  the  members  of  ,  a  few  more 
auxiliary  definitions  are  needed.  Given  Xq  e  Y^,  V^(Xq)  is 
the  number  such  that  the  triple  X(v^(Xq),  Xq) ,  k(v^(XQ) ,  Xq) , 
Mn>S(vM(X0),  Xq)  is  concluding.  Set  RM(XQ)  =  X(vM(XQ)  +  1,XQ) 
and  ^(Xq)  =  Bk(0^X0)(0,X0),  Bk(1'X0>  (1  ,XQ)  ,  .... 

Bk(vM^X0^  X0^(v^(Xq)^  Xq)  .  The  scheme  Mn,S(T;X)  is  said 
to  describe  the  operator  A  over  the  set  Y^  if  A(Xq)  = 

R^(Xq)  for  Xq  e  Y^.  Thus,  if  Y^  =j=  Y,  a  single  scheme  can 
describe  different  operators.  Consider,  now,  the  set  Mq 
of  all  schemes  M  such  that 

(a)  the  sequence  M(0,Xq)  contains  no  functors; 

00  YM  *  Y ; 

(c)  the  set  {L^(Xq)},  Xq  e  Y,  is  finite,  and  each 
member  terminates  in  an  operator. 

It  follows  that  %*  %1M  e  Mo5' 

2.3.2.  An  Example .  To  illustrate  some  of  the  above 
notions,  consider  the  sequence  =  A,  B,  (p^,6),  C, 

(p-^,  1),  D,  (p2->  1)-  Here  A,  B,  C,  and  D  are  operators, 
and  p^  and  P2  are  predicates.  We  take  the  cases  (a)  p-^  = 


l, 
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p2  =  1,  (b)  px  =  0,  =  1,  (c)  pj^  =  1,  p2  s  0,  and  (d) 

p^  s  0^  p2  s  0.  For  an  arbitrary  initial  Xq  e  Y  the 
sequences  X(t,Xq)  and  k(T,Xg)  in  cases  (a)  and  (b),  respectively , 
are 


(a) 


(b) 


XQ  A(X0)  B (A (Xg) )  B(A(Xg))  C(B(A(Xg))) 
0  12  3  4 

C(B(A(Xg)))  D  (C  (B  (A  (Xg)  )  )  )  D(C(B(A(Xg) 

5  6  7 

Xg  A (Xg )  B(A(Xg))  B(A(Xg))  B(A(Xg)) 

0  12  6  7 


Also,  in  case  (a),  Y^6,0  =  Y,  L^(X)  -  A,  B,  (p-^  6),  C,  (p^j  1)> 

D,  (p9,  1),  and  R  ^  q  =  A  •  B  •  C  ■  D;  whereas  in  case  (b), 
z  M  5 

Y6,0  =  Y,  L^X)  =  A,  B,  (p-^  6) ,  (p2^  1),  and  R^g  =  A  •  B. 

In  cases  (c)  and  (d),  the  generated  sequence  of  triples 
is  infinite  and  contains  no  concluding  triple.  Hence,  in 
these  cases  Y  q  q  =  0  and  L^(X)  and  q  are  undefined. 

2.3.3.  Sub schemes.  Prior  to  considering  questions 
about  the  transformation  of  one  scheme  into  another,  basic 
questions  on  the  relations  of  schemes  arise.  For  example, 
when  is  a  scheme  M2  to  be  considered  a  subscheme  of  scheme 
M-^?  Also,  what  extra  conditions  must  a  scheme  satisfy 
in  order  to  serve  as  an  obvious  abstraction  of  Lyapunov's 
program  schemes? 

n  s 

Given  a  scheme  M  ’  (t,X)  and  for  Xq  e  the  sequence 
1*1  (Xq),  the  subsequence  I^(Xq)  =  Bk  (p0'X0)(Pg,x0) ,  ..., 
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Bk(px,XQ)  of  L^CXq)  that  consists  exactly  of  the  occurrences 
of  operators  in  L^Xq)  is  called  an  operator  sequence. 

Here  X(ppXQ)  =  C°  •  C1 . . . C1"1(Xi) ,  for  0  <  i  <  where  Cm 
Bk(Pm^o\(pm,X0),  m  =  Oj  1,  .  . 


.  X.  Suppose  that  N-^(X^)  = 
Cp  .  .  .  ,  C^l  and  N2 (X2)  =  Cp  Cp  ■  ,  where  X^  and 

X2  are  memory— states ,  are  two  sequences  of  operators. 
Associated  with  each  operator  C1(rr  =  1,  2,  i  =  1,  2,  p 


is  a  memory-state  X^  =  •  C^...C^  ^(X®).  The  sequence 

N2(X2)  is  said  to  include  the  sequence  N-^(X^)  over  the 
| set  J  c  z|(N2  (X2)  2  N^(X^)[J])  if  there  is  a  subsequence 
N2(X2)  =  C2°; 


rs  1 
'-'2  3 


,  C2nl,  of  N2(X2)  such  that 


s . 


(a)  =  Cp  i  =  0,  1,  np 

s . 

(b)  X21(Z)  =  X^(Z)  for  Z  e  J  and  i  =  0,  1,  np 


Let  Y^  and.  Y^  be  sets  of  admissible  memory-states  of 
schemes  M-^  and  M2,  respectively;  then  X"  €  Y^  is  said  to 
be  an  M-^-associate  of  X1  €  Y^  over  J  c  Z  if 


and 


(a)  L*  (X")  3  Lm  (X')[JJ, 

u  2  nl 

(b)  if  over  J,  Rm  (Xn)  =  RM  (X1) 


M-, 


Consider  a  subset  Y*  of  Y„,  .  Scheme  M0  is  said  to  include 

Mp  M-^  2 

scheme  M,  over  sets  J  and  YM  if  for  each  X1  e  Y£  ,  there  is 
1 

at  least  one  X"  e  Y>,  that  is  an  M.,— associate  of  X'  over 

J  2 

J.  Notation:  M0  ^  M, [Y*  ]. 

2  -*  1 
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Thus,  scheme  M-^  is  included  in  scheme  M2  relative  to 

a  subset  T  of  the  memory  and  subset  of  the  admissible 

states  Y,,  of  M-,  if  for  each  X'  e  YM  there  is  an  X"  e  Yx, 

1  M2 

such  that  over  T  the  operator  sequence  generated  by  M2  in¬ 
cludes  the  operator  sequence  generated  by  M-^  if  the  memory 
states  at  which  and  M2  terminate  coincide  over  T. 

Podlovchenko  makes  some  observations  about  this  inclu¬ 
sion  relation,  and  the  simpler  ones  are  as  follows: 

T 

(1)  If  P  c  I  and  Y**  c  Y*  and  M2  Z  Mx [Y*  ], 

rjn*  11  1 

then  M2  ^  MX[Y**]. 

1  T  T 

(2)  Suppose  M2  Z  Ml [Y*  J  and  M3  U  M2[YM  ].  Let  Y*^ 

be  the  subset  of  Y^  consisting  of  all  memory  states  that 

2  * 
are  the  M-.— associates  of  at  least  one  member  of  Ym  •  If 

1  1 


=  Y*  Pi  Y^  and  T  =  TflT  are  nonempty,  then  3  ^ 


where  YM  c:  Y£  consists  of  those  states  having  at 
nl  nl 

least  one  M,—  associate  in  Yx,  . 

1  m2 

2.3.4.  Reduction  of  an  Abstract  Scheme  to  Form  T.  To 
n  s 

reduce  a  scheme  M  *  (t,X)  into  a  form  more  nearly  approximating 

the  program  schemes  of  Lyapunov,  a  few  more  conditions  are 
imposed.  Attention  is  focused  on  the  values  taken  by  an 
element  B^(t,X)  of  a  scheme  Mn*s(T,X)  until  a  concluding 
triple  is  reached;  that  is,  if  X  e  Y^,  let  T^(M,Xq)  = 

[B^(v,Xq)}  for  v  =  0,  ...,  vm(Xq) .  The  element  B^(t,X)  is 
called  an  operator  over  the  set  Y^  c:  Ym  if  M^(M,Y*)  = 


LM 


M; 


U  T,  (X,Xn)  is  a  subset  of  GC-  The  notions  of  logical  con— 
X0eYM 

dition  and  a  functor  over  Y^  are  similarly  defined.  A  logical 
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element  Bk(T,M)  g  Mn  ^ s  (t  ,X)  is  called  directed  if  the 

"X* 

logical  conditions  of  the  set  T^.  (M, Y^)  differ  from  one 
another  only  in  their  predicates.  Bk(T,X)  is  called 
M— correct  if  one  of  the  following  conditions  hold: 

(a)  Bk(0,X)  £  W, 

(b)  Bk(0,X)  =  (§k;hm)  eW  ,0<hm<n  +  s. 

A  scheme  Mn*s(T,X)  is  said  to  be  representable  over 

* 

Y,,  c:  Y„  if  each  element  is  either  an  operator,  or  a 
M  —  M 

directed  logical  element,  or  an  IP-correct  functor. 

The  significance  of  the  representable  schemes  lies 

in  this:  They  are  easily  and  naturally  put  into  a  form 

recognizably  similar  to  that  of  program  schemes,  the 

form  (T),  to  use  Podlovchenko ' s  term.  Consider,  then, 

a  scheme  Mn,S(T,X)  that  is  representable  over  Y^  £  Y^. 

With  each  logical  element  B1(t,X)  =  p1(T,X),  t1)  over 

Y>,  there  is  associated  a  natural  number  r.  and  two  arrows 
M  r .  l 

,1 

indexed  with  r.:  an  entering  arrow  1  and  an  exiting 
r  •  1 

arrow  f  -  It  is  understood  that  r.  =  r.  if  and  only 

. 1  J  .  ri 

if  i  =  j  .  The  element  (p1  (t  ,X)  ,  t1)  becomes  p1(T,X)/f  ,  and 
r . 

^  is  placed  immediately  before  (to  the  left  of)  the  element 
B^  (t,X)  if  0  <  <  n,  and  to  the  right  of  the  element 

n  i  * 

B  (t,X)  if  n  <  i  .  In  place  of  each  functor  over  Y^,  that 

is,  an  element  of  the  form  Bk(T,X)  =  (§k,fk,mk),  0  <  k  < 

n  +  s,  one  writes  the  expression  §k  and  places  the  number  k 

,k  rrm 

beneath  the  element  B  (t,X)  and  above  the  element  B  k(t,X). 

A  vertical  stroke  is  placed  just  before  the  element  Bn (t ,X) , 
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and  all  occurrences  of  commas  in  the  scheme  are  omitted. 
The  result  of  these  alterations  is  the  form  (r )  of  the 
scheme  Mrij’s(TJX)  over  Y*.  As  YM  changes ,  the  form  (r)  of 
Mn’S(T,X)  may  change.  Also,  it  is  obvious  that  there  are 
several  forms  (r)  of  a  scheme  M  *  (t,X)  even  over  a  single 
set  Y^;  these  several  forms  result  from  notational  changes 
such  as  choosing  different  indices  for  the  logical 
conditions,  etc. 

Let  us  take  the  previous  example  of  a  scheme 

and  rewrite  it  in  a  form  (r) .  Application  of  the  above 
rules  results  in 

3  2  1  2  13 

M6  ’  °  =  A  i  i  BP]_  f  CP]_  T  D  i  p2  f- 


Next,  suppose  the  sequence 


M4j1(0,X)  =  ($° ,  5 , 1)  ,  A,D,(§3,!,),  (Pl,l),  B 


defines  a  scheme  M4,,3(t,X),  where  A,  D,  B  €  Cl,  I3  e  CC1 , 

p  e  .  Here  the  operators  D  and  B  are  assumed  constant. 
Assuming  that  scheme  M4j^(t,X)  is  representable  for  some 
Xn  e  Y  ,  ,  an  instance  of  the  form  (T )  is 

u 


M4j1(t,X)  =  1° 


1 

X)D$3p  T 


B- 

0 


2.3.5.  Transformations  and  Parametrization  of  Schemes. 
It  is  to  be  observed  that  the  starting  form  Mn,S(0,X)  of  a 
sequence  MnjS(T,x)  completely  defines  the  operation  and 
structure  of  this  sequence.  Consequently,  to  discuss 
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transformations  of  such  sequences  *  it  suffices  to  discuss 

transformations  of  their  starting  forms. 

A  segment  cp^  r  =  (0,X)  ,  .  .  .  ,  B^c+r  (0,X) ,  k  +  r  <  n 

of  given  M  (0,X)  is  said  to  be  free,  roughly  speaking, 
n  y  s 

n  g 

if  among  the  first  n  +  1  elements  of  the  sequence  M  J  (0,X) 
which  are  functors  or  logical  conditions  not  in  the  segment, 
the  affect  of  these  elements  falls  outside  the  segment 
cp^.  r-  More  precisely,  cp^  r  is  said  to  be  free  if 

(a)  for  each  functor  B^~(0,X)  =  (§^,  ^'^m'*")  e  Mn-’s(0,X), 
0  <  i  <  n,  it  is  true  that  -t1,  m1  ^  k,  k+1,  .  .  .  , 

k  +  r ;  and  if 

(b)  for  each  logical  condition  B1(0,X)  =  (p1,^1)  in 

Mn,S(0,X)  that  does  not  occur  in  the  segment, 
it  is  true  that  ■t1^k,  k  +  1,  k  +  r. 

Consider  a  sequence  Mn,s(0,X)  capable  of  being 

represented  in  the  form  (F ) ,  a  free  segment  cp^  of  the 

~0 

same,  and  a  sequence  =  B  ,  • • B  ,  r  >  —  1,  of  elements 
of  a  U  W  0^  ■  Suppose  Mn,s(0,X)  is  put  into  the  form 

(r),  and  the  segment  cp^  r  is  replaced  by  the  sequence 
giving  a  sequence  Mn~*~r  r,s(0,X),  which  defines  a 


sequence  M 


n+r— r ,  s 


(t,x).  In  brief. 


Mn+r  r^s(T,X)  =  Mn^S(T,X)  -  cpk^}. 

Consider  now  the  alteration  of  a  memory  state  at  a 
single  cell  Zq  e  Z;  that  is,  for  Xq  e  Y  and  x  e  G, 
consider  the  memory  state  X  such  that  X(z)  =  X^(z)  for 
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^  Zq  and  X(zq)  =  x;  write  Xq  [x  -  Zq] . 

If  M  is  a  scheme,  the  cell  Zq  g  Z  is  said  to  be  M-free 


over  £  Ym  if  for  Xn  e  Y~  and  x  e  G,  Xn[j 


J  e  Y„  and 


(a)  L^Xq)  =  ^(XqHx  -  z0l). 


(b)  for  each  0  <  T  <  v^CXq)  +  1,  the  memory-states 

X(t ,Xq)  and  X(t,Xq[x  -  Zq] )  differ  at  most  on  Zq, 
and  all  X(t,X0)  and  all  X(t,X0[x  -  zQ] )  have  the 
same  value  on  Zq.  The  set  Z(M,Y^)  of  all  cells  in 


Z  that  are  not  M-free  over  Y^  are  said  to  be  M-used 

mX* 

over  Y^.  Now,  we  associate  with  each  scheme  Mq  and 

•>u  ^ 

set  Y“  -  Ym  the  set  V(Mn,YM  )  of  all  schemes  M 
M0  “0  *  0 
such  that  M  =5  Mq[Y^  ],  where  J  is  MQ-used  over 

^  ~k 

Y^  .  If  M  e  \  ^  an<^  sonie  rule  ™aps  M 

into  a  scheme  M ' ,  this  rule  is  called  a  trans¬ 


formation  of  M  into  M",  and  is  said  to  be 

Mg-invariant  over  Y^  if  M  e  T>\(Mq,  Y^) . 

For  any  integral  m  >  1,  consider  a  finite  set  Im  = 

{ (i^,i2, . . • where  the  ig  assume  only  integral  values. 

Let  l^s)  denote  the  projection  of  the  set  I  out  the  i  -axis, 
m  m» 

For  m  >  1,  if  in  each  set  I^S\  s  =  there  is  a 

point  that  is  the  image  of  at  least  two  points  of  Im, 

I  is  said  to  be  nonuniform.  By  definition,  I-,  is  non- 
m  -  L 

uniform.  A  parametrization  of  a  set  K  is  a  mapping  q 


of  an  I  onto  K,  and  i^  i2,  .  im  are  said  to  be  parameters 
of  the  set  K.  If  q  is  one-to-one,  the  parametrization  is 
called  restricted.  A  region  Jg  =  { ( j j  , ^2 >  • • • > J s  ) 3  is  an 
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extension  of  the  region  {  ( i-^,  ±2  >  •  •  •  j  i-m)  ^  if  s  >  m,  and  for 
each  point  (i^ , ^ j  •  .  •  ^m)  e  Im  there  is  a  point 

e  Jg  such  that  ix  =  jpi2  =  =  41 

The  introduction  of  the  notion  of  a  parametrization 
enables  the  elements  of  a  scheme  to  be  represented  in  more 
customary  fashion.  Consider  a  scheme  M  ’  (t jX) •  Let 
T*(M,Xq)  =  [B^ (t^jXq) | e  v^(X0),  XQ  e  Ym,  0  <  l  4  n  +  s} . 
Suppose  that  T  (M,Xq)  is  parametrized  by  use  of  the  region 
Ju  =  { (j1, i2,  ■  •  •  ,ju)3  ■  For  t1  e  v^(XQ),  each  pair  (t^Xq) 
defines  an  element  B^(t^,Xq)  e  T^(MjXq).  Let  (j  •  •  •  * Ju^) 
be  a  preimage  of  B^Ct^Xq)  in  J  .  Define  a  correspondence 
II  by 


as  B 


n (t ^ , Xq)  —  (jpj2j  •  •  •  T  e  (xo>  * 

This  done^  the  element  B^t^Xq)  can  be  represented 
if  .  .  and  a  logical  element  as  (pf  .  .  >  )  • 

JlJ2---Ju  J  i  J  2  •  •  ’  J  u 5  ^ 


2.3.6.  Reduction  of  an  Abstract  Scheme  to  a  Program 
Scheme .  A  scheme  MQ  such  that  its  starting  form  consists 
only  of  elements  from  a  Vg  is  called  a  calculation  scheme. 
Any  member  of  the  set  7^(Mq,Xq)  is  a  program  scheme 
corresponding  to  the  calculation  scheme  Mq  and  admissible 
state  Xq. 

To  take  a  particular  case,  suppose  A  e  (Zand 


n  +  1  times 
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It  is  easy  to  construct  a  program  scheme  corresponding 

n  Q  _ 

to  Mqj  in  which  the  operator  A  occurs  just  once.  Let 

6^)  be  a  function  of  n^  variables  (uq  >  1)  that  maps 
nn 

G  into  G.  The  function  y  defined  by 


x(6 


(1) 


'0 


X(z))  =  6(1)(X(z,),  X (z~) , 


takes  Y  into  G.  Let  z  be  a  member  of  Z.  The  function 


X 


(z)  « 


x(z)  if  z  ^  z, 

x  (6  ^ ;  Zp  •  •  •  .>  zn  ;  x(z) )  if  z  =  z, 


0 


X  €  Y,  defines  an  operator ;  called  an  elementary  operatoi 
and  is  denoted  by 

;  A(6  ;  z13  z2,  zn^,  z,  X) . 


Taking  n  =  3, 

=  (z'  -*  Zq)1  A  A(6jJ-;;  Zq,  z'  ,  zQ ;  X)  p  (zQ  =  z")|- 


=  (  r,  '  — ♦  ^  X  I  A  A  (K  • 


In  this  case,  n^  =  2,  z  =  Zq,  and  6^  ^(x^,  X2)  =  x-^  +  X2 . 

f 

Now,  given  an  initial  state  X  such  that 


X'(z')  =  1,  X ' (z ")  =  n  +  2, 


x (zn  )> 

n0 


the  operator  A  is  executed  n  +  1  times.  It  follows  from  the 
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definition  of  Mq— used  that  the  condition 
z0,  z',  z"  £  Z (Mq ,XQ) , 

3  0 

where  Xq  is  a  state,  reduces  to  M'5-’  e  ?7(Mq,Xq). 

Also,  a  memory— state  X1  which  besides  having  the  designated 
values  on  z’  and  zT1  also  agrees  with  Xq  for  z  e  Z(Mq,  Xq), 
is  an  M0-associate  of  XQ.  If  the  program  scheme  is  to  be 
considered  only  with  respect  to  such  states,  it  assumes  the 
form 

,  n  1  _ 

=  (1  -  Zq)  j  A  f (zq)p (zq  =  n  +  2), 

where  f(z)  is  short  for  the  operator  A(6^^;  z,  z,  z;  X) 
with  X(z)  =  1  for  z  e  Z. 

3  0 

Thus,  the  program  scheme  M  3  consists  of  just  four 
elements,  no  matter  how  large  n  is.  Notice,  however,  that 
if  vMq(Xq)  =  n,  then  vM3,0  (X1)  =  Bn. 

2.4.  Algebraic  Treatment  of  Operator  Programming 

A.  A.  Lyapunov,  who  more  than  anyone  else  should  be 
considered  the  originator  of  the  operator  approach  to 
programming,  feels  that  isolation  of  the  notions  of 
operator  programming  from  the  body  of  mathematics  condemns 
the  former  to  sterility.  The  problem,  as  he  sees  it,  is 
to  define  the  mathematical  principles  basic  to  programming 
so  that  the  methods  of  the  more  suitable  branches  of 
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mathematics  can  be  brought  to  bear.  He  judges  that  the 
work  of  Yanovj  Podlovchenko ,  and  others  on  the  transfor¬ 
mations  of  program  schemes  reveals  a  similarity  between 
these  transformations  and  the  general  classes  of  transforma¬ 
tions  studied  in  the  theory  of  categories  [22].  This  paper 
is  brief  and  sketchy.,  with  a  good  number  of  the  proofs 
omitted.  It  nevertheless  occupies  a  position  relative  to 
the  algebraic  papers  analgous  to  that  of  Lyapunov's  [21]  in 
the  whole  series:  it  gets  the  show  on  the  road.  It  sets 
the  stage  for  the  topics  pursued  in  ensuing  papers,  especially 
those  of  Glebov .  In  the  sequel,  the  order  of  topics  taken 
up  in  Lyapunov's  paper  has  been  somewhat  altered  to  provide 
an  easy  passage  into  Glebov 's  [14]. 

2.4.1.  Basic  Notions.  If  G,  G,  and  M  designate  the 
memory,  the  set  of  states  of  the  memory  cells,  and  the  set 
of  memory— states ,  respectively,  all  as  defined  in  Podlovchenko ' s 
[29],  a  mapping  A:!^  -  M2 ,  c  M,  M2  c  M  is  called  an 
operator  over  G .  The  composition  of  operators  is  defined 
as  above;  that  is,  if  A:M^  -*  k^  and  B:!^  "*  M^,  then  A  •  B:M^  -*  M, 
with,  by  definition,  AB(f )  =  B(A(f)) ,  f  e  Mj_.  The  class  of 
operators  over  G  constitutes  a  category  K^.  The  objects 
of  are  the  subsets  M1  of  M;  the  abstract  maps  are  the 
operators  over  0,  and  the  identity  associated  with  each 
object  M'  is  the  identity  operator  defined  on  M1 . 

Given  a  set  U  =  [u]  and  c  M,  a  mapping  prM-^  -  u  is 
called  a  predicate  over  G.  Suppose  a  system  Au  of  operators 
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is  given  that  are  indexed  by  the  members  u  of  some  set 

U1  Ul  —  . 

c  U.  It  is  allowed  that  A  =  A  ^  even  though  u1  f  u2 . 

The  operator  B  defined  by  p— composition  is  prescribed  by 
the  following  equation: 

B(f)  =  Au(f)  where  p(f)  =  u. 

If  p  =  [p]  is  a  class  of  predicates  over  0,  and  K  is  a 
class  of  operators  over  fi ,  K  is  said  to  be  closed  with 
respect  to  P  if  K  is  closed  with  respect  to  p— composition 
of  elements  for  p  e  P. 

Lyapunov  employs  this  closure  definition  to  introduce 
an  equivalence  relation  between  classes  of  predicates  over 
fi  which  enables  him  to  characterize  these  classes  algebraically. 
Thus,  class  P^  of  predicates  over  Q  is  said  to  be  subordinate 
to  class  P2  if  each  class  of  operators  that  is  closed  with 
respect  to  P-^  is  closed  with  respect  to  P2-  The  relation 
R  defined  by  P-jJRI^  if  and  only  if  P^  is  subordinate  to  P2 
and  ?2  is  subordinate  to  P^  is  an  equivalence  relation. 
Obviously,  the  relation  of  P^  being  subordinate  to  P2  is  a 
partial  order  relation  and  induces  a  partial  ordering  on 
the  set  of  equivalence  classes  of  predicates  over  0. 

The  smallest  algebra  of  subsets  of  M  that  includes 
all  preimages  of  elements  u  in  the  range  of  p  for  all 
p  e  P,  is  termed  the  algebra  generated  by  P.  Notation:  (A. p- 

The  fact  is  that  class  P^  is  subordinate  to  class  P2 
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if  and  only  if  Ci L  c=  O  ,  and  that  the  classes  of  equiva- 

j  P]_  «-^P2 

lent  predicates  over  Q  constitute  a  complete  lattice  under 
the  aforementioned  partial  ordering.  Suppose  besides  K  and 
P  we  are  given  a  class  H  =  [h]  of  functions  mapping  U  into 
the  natural  numbers  and  an  expression  STOP.  A  K— term  is 
an  ordered  pair  (A,m)  where  A  e  K  and  m  is  a  natural  number. 

A  P— term  is  an  ordered  pair  (p,h),  p  €  P  and  h  e  H.  STOP 
is  a  0— term.  It  is  assumed  that  all  K— terms,  P— terms ,  and 
the  0— term  are  distinct.  By  a  term  is  meant  a  K— term  or 
a  P— term,  or  the  0— term. 

A  logical  scheme  is  a  sequence  of  terms  ,  •••, 

a^,  and  defines  an  operator  B  over  Q  according  to  the  following 
prescription.  Let  fp  be  the  starting  memory  state. 

(a)  Initially,  the  term  with  smallest  subscript  is 


marked . 

Suppose  the  term  cu  has  been  marked  and  the  current 
memory  state  is  f. 

(b)  If  ct^  is  a  K— term,  =  (A,m),  then  the  memory 
state  f  is  changed  to  A(f)  and  the  next  term  marked  is  a  . 
If  A (f )  is  undefined,  then  the  process  terminates  and  B(fQ> 
is  undefined. 

(c)  If  ai  is  a  P— term,  cu  =  (p,h),  then  the  memory 
state  continues  to  be  f  and  the  next  term  marked  is 
where  p(f)  =  u. 

(d)  If  cu  is  the  0— term  and  f  is  the  current  memory 
state,  then  the  process  terminates  and  BCfg)  =  f. 
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(e)  If  by  application  of  the  above.,  the  process  of 
marking  next  terms  continues  indefinitely,  but  from  some 
point  on  the  current  memory  state  remains  f,  then  B(fg)  =  f- 
If  the  current  memory  state  never  becomes  constant,  then 
B ( f q )  is  undefined. 

Logical  schemes  admit  of  an  algebraic  characterization 
when  Cl  and  G  are  finite.  Suppose  this  is  the  case,  and 
that  K  contains  the  identity  operator  on  Q.  Lyapunov 
states  that  the  set  of  operators  representable  by  logical 
schemes  is  the  smallest  category  (in  the  obvious  sense) 
of  operators  that  includes  K  and  is  closed  with  respect 
to  p— composition  for  p  e  P- 

Since  a  logical  scheme  defines  an  operator  over  Cl, 
and  hence  alters  the  state  of  the  memory,  one  may  think 
of  an  auxiliary  memory  fi1  =  { c 1 }  in  which  logical  schemes 
are  stored  as  exercising  a  measure  of  control  over  0, 
briefly  as  a  control  memory.  Let  G'  =  { g ’ 3  and  M1  =  [m'] 
be  the  set  of  states  and  memory— s tat es ,  respectively, 
associated  with  fi'.  Associated  with  each  cell  c'  is  the 
value  6  (c ' )  =  1.  Assume  now  a  1  to  1  correspondence  m  has 
been  established  between  all  terms  a  and  the  states  g', 
and  that  the  memory  cells  have  been  indexed  via  a  mapping 
into  the  natural  numbers. 


Let  c^,  . ..,  an,  . . . )  be  a  logical  scheme  and 


N  a  set  of  natural  numbers 
0-.  Let  QjJj  c: 


serving  as  an  index  set  for 
Q '  be  the  set  of  cells  with 


the  terms  of 


index  set  N.  By  a  code  of  the  logical  scheme  is  meant  the 


memory  state  m^ 


*4(c>  = 


such  that 

(  m(an)  if  c  =  cn, 
I  STOP  if  c  i  QjJj. 


Thus  the  logical  scheme  $  is  encoded  in  the  auxiliary  memory 
fi'.  The  changes  effected  in  the  state  of  0  by  operation  of 
now  take  the  following  appearance  in  terms  of  the  code  " 

(a)  Initially.,  6(c^)  =  1- 

(b)  The  term  is  executed  whose  encoded  form  occupies 
I  cell  c  such  that  5(c)  =  1.  According  to  the  process 
defined  earlier,  the  next  term  to  be  executed  is  defined. 

Let  c '  be  the  cell  containing  the  code  for  this  next  term. 
Then  5  ( c  1  )  =  1 . 

(c)  If  the  code  for  the  0-term  appears  in  cell  c 
such  that  6(c)  =  1,  or  if  the  memory-state  f  of  fi  becomes 
constant  from  some  point  on,  the  process  of  transforming  fi 
terminates  and  B(fg)  =  f,  where  fQ  is  the  initial  memory- 
state  . 

This  relation  of  an  auxiliary  memory  fi'  controlling  a 
memory  fi  can  obviously  be  iterated.  Accordingly,  fi'  is 
said  to  be  of  rank  1  over  0 ,  and  if  a  memory  fin  of  rank 
n  over  fi  has  been  defined,  then  a  memory  fin+^  controlling 
fi  is  said  to  be  of  rank  n  +  1  over  fi. 

Lyapunov  also  undertakes  to  characterize  algebraically 
classes  of  operators  that  specialize  to  such  things  as 
readdress  operators.  To  this  end,  consider  a  set  Z  =  fz} 
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and  a  set  A  =  {6}  of  partial  transformations  of  Z.  Zg  = 

{z|z  €  Z  and  6(z)  is  defined}.  By  the  sum  of  transformations 
6^  and  &2  is  meant  the  composition  of  6^  with  ^7  that  is, 

(&i  +  §2)  (z)  =  Denoting  &(z)  by  z  +  6  we  have 

z  +  (6^  +  §2)  =  (z  4-  6^)  +  6 2  whenever  z  +  6^  e  Zg  .  In 
the  sequel  it  is  assumed  that  A  is  closed  with  respect  to 
composition  and  that  the  latter  is  commutative  whenever 
both  6^  +  62  and  6  2  +  6^  are  defined.  Note  that  composition 
is  associative  if  either  6-^  +  (&2  +  63)  or  (6^  +  §2)  +  6^ 
is  defined. 


Operators  over  Q  are,  by  definition,  operators  of 
rank  1.  A  mapping  of  subsets  of  categories  of  operators  of 
rank  n  into  themselves  are  operators  of  rank  n  +  1.  These 
mappings  also  form  a  category.  Now  consider  a  mapping 


n:z  -  1^. 
we  define 


Writing  n(z)  =  Az  and  assuming  6  e  A  and  z  +  6  e  Z, 


B6(Az(f))  -  A2  +  6(£). 

Note  that  Bg  is  of  rank  2  and  is  called  a  6 -shift  of  M. 

Note  also  that  Be  and  B*  commute. 

1  2 

Next,  consider  a  function  ¥  defined  on  c  M,  and 
define  Y  to  be  ft^-consistent  if 

(a)  fx  e  M1  and  f-^x)  =  f2(x)  for  all  x  e  [11  implies 
that  f2  e  M^, 

(b)  fx  and  f2  e  and  f-j^x)  =  f2(x)  for  all  x  e  flp 
then  ¥(fx)  =  ¥ ( f 2 ) . 


and 
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By  an  Q-j— restriction  of  an  consistent  function  Y 
defined  on  M-^  c  M  is  meant  a  function  Y  whose  domain 
includes  M-j^  such  that  Y(f)  =  Y  (f )  if  f(x)  =  f(x)  for  x  e 
and  f  €  M-^.  Notation:  Y(f)  =  Y(f/fi^). 

Lyapunov  lists  the  following  properties  of  restrictions 
of  £1— consistent  predicates  or  operators  over  Cl: 

(a.)  If  some  class  of  consistent  predicates  over  Q 
is  invariant  with  respect  to  some  operation  over  the  values 
of  the  predicates,  its  res triction  has  the  same  property. 

(b)  If  the  set  of  G-^-consistent  operators  form  a  category, 
then  their  Q-j— restrictions  also  form  a  category,  the  fij— 
restriction  of  the  original  category. 

(c)  A  mapping  taking  each  operator  of  some  category 
to  its  restriction  maps  the  given  category  onto  its 

fi j— restriction . 

(d)  An  £1^— restriction  of  a  class  of  consistent 
operators  that  is  closed  with  respect  to  the  class  P  of 
Qj—  consistent  predicates  may  be  represented  as  a  class  of 
operators  closed  with  respect  to  the  Qj— restriction  of 
class  P. 

2.4.2.  (n ,  m)— Operators  and  Predicates.  Suppose  a 

mapping  v:Z  -  Cl  is  given.  An  n— tuple  of  cells  (x-^,  , 

. . . ,  xn)  and  memory  state  f  and  a  function  F  defined  on  Gn= 

GxGx .  xG^  defines  an  n— function  of  special  form  of  the  memory 
n  factors 
state  if 
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cp(x1,  .  .  .  ,xnlf)  =  F(f(x]_)J  f  (x2),  .  .  .  ,f(xn)). 

If  F  in  the  above  takes  Gn  into  some  set  U*  the 
equation  defines  a  predicate  of  special  form-  An  n — function 
of  special  form  is  called  an  (n ,m)— operation  if  F:G  ■*  G  . 

A  special  case  of  an  n— function  that  is  of  interest 
is  an  (n  ,m)— operator .  Suppose  y;L>---jym  are  m  distinct 
cells  and  an  (n  ,m)- operation  cp(x-^,  x2*  ■  •  •  >  xn|f)  is  given. 
Then  the  equation 


A(f)  =  fp 


where  f-^(x)  =  if  x  =  yp  and  f-^(x)  =  f(x)  if  x  +  y.  for 
i  =  1,  2,  . . . ,  m,  defines  an  (n ,m)-operator  of  special  form. 

Notation:  A(cp(xpx2,  .  .  .  ,xn|  f  ) ,  ypy2>  •  •  •  >ym)  = 

Let  x.  =  x1  for  z  e  Z}  6  e  A,  z  +  8  e  Z.  The  operators 
1  z 

g  (9(xp  .  •  •  >xi_l»xz5Xi+l5  •  •  •  5xn^^ 

=  «P(x1,  .  ..  ,xi_1,  x^+6,xi+1,  .  .  .  ,xj  f),  i  <  n, 

Bn+i  6  (A(t(x15x2’  •  •  •  >xrJ  f)’yl>  •  •  '  ’yi-l,yz’yi+l’  ‘  '  ‘  ,ym^ 
=  a(9(x1#  . . .  ,xn|  f),y1,-  *  •  •  >yi_i>yz+6  »yi+i»  •  •  •  ,ym^’  1  -m 


-74- 


are  called  elementary  readdress  operators. 

A  readdress  operator  is  a  product  of  elementary  readdress 
operators.  It  is  clear  that  composition  of  readdress  operators 
is  commutative.  The  reader  will  notice  that  readdressing  is  a 
special  case  of  the  shift  operation,  while  operators  and 
predicates  of  special  form  are  special  cases  of  Q-j—  restrictions . 

2.4.3.  Synthesis  of  (n ,111)— Operators .  In  the  case  of 
(n ,m)— operators ,  one  has  a  quantitative  measure  of  the 
complexity  of  these  operators,  namely,  the  numbers  m  and  n. 

This  invites  an  attempt  to  represent  members  of  this  class  in 
terms  of  the  more  simple  members.  The  problem  is  that  of  the 
synthesis  of  an  operator  from  given,  simple  operators  by 
representation  of  the  former  as  a  product  of  the  latter; 
this  is  considered  by  Glebov  in  [14] .  Since  the  problem 
is  one  of  synthesis,  it  is  not  surprising  that  the  proofs 
of  the  theorems  of  the  paper  are  constructive  and  some 
genuine  computational  questions  arise  concerning  the 
efficiency  of  the  method  of  synthesis. 

The  synthesis  problems  treated  by  Glebov  are  as 
follows : 

(1)  Synthesis  of  (n,m)-operators  from  (n, 1) -operators 

(2)  Synthesis  of  (n, 1 ) -operators  from  (m, l)-operators . 

(3)  Synthesis  of  (n,m)-operators  from  (1, l)-operators 


with  1-predicates. 
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Relative  to  (3),  an  operator  is  said  to  be  obtained 

by  synthesis  of  operators  and  predicates  of  a  given  class  if 

it  can  be  obtained  from  this  given  class  by  means  of  the 

operations  of  multiplication  and  p— composition . 

In  answer  to  (1)  Glebov  proves:  If  a  memory  Q  = 

{xpX2j  •  ■  ■  jX  }  consists  of  n  cells  each  of  which  admits  of 

a  finite  number  of  states,  then  any  operator  over  Cl  can  be 

synthesized  from  (n , 1)— operators .  In  the  course  of  the 

proof  of  this  assertion,  Glebov  introduces  the  notions  of 

a  transposition  operator  and  a  reduction  operator. 

A  transposition  operator  [g(x),g'(x)]  is  a  mapping  of 

Q  that  maps  the  element  g  and  g'  of  the  set  M  of  memory  states 

into  one  another  and  leaves  all  other  members  of  M  fixed. 

* 

A  reduction  operator  [ g , g * ]  is  a  mapping  of  M  that  takes 
g  to  g 1  and  leaves  all  other  members  of  M  fixed. 

To  consider  the  question  of  estimating  the  efficiency 
of  the  method  of  synthesis,  a  special  type  of  transposition - 
and  reduction  operator  is  defined.  An  elementary  transposi¬ 
tion  operator  (g|g')^  is  defined  only  when  g  =}=  g '  and  g 
differs  from  g'  in  only  its  value  on  some  one  cell  x^; 
that  is,  g(xi)  =f  g'(xi)  and  g(xj)  =  g '  )  for  j  +  i  •  Under 

these  conditions  (g,g')^  interchanges  g  and  g',  and  elementary 

* 

reduction  operator  (g  J  g ’ ) ^  is  defined  as  was  an  elementary 
transposition  operator  with  the  difference  that,  when 

-X- 

defined,  (g 1 g ' ) ^  takes  g  to  g'  and  leaves  all  other 
members  of  M  invariant. 
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Let  N  be  the  least  integer  such  that  every  operator 
n  is  representable  as  a  product  of  elementary  transposi¬ 
tion  and  reduction  operators.  Glebov  shows  that  if  each 
of  the  n  memory  cells  admits  of  q  states,  then 

C(n,q)qn  <  N  where  3/7  <  C(n,q)  <  1. 

He  expresses  his  belief  that  the  upper  bound  is  very  crude. 

To  handle  the  general  case  of  (1)  he  proves:  If  G  is 
an  arbitrary  memory  each  cell  of  which  admits  of  a  finite 
number  of  states,  then  any  (n ,m)— operator  over  Q  can  be 
synthesized  from  (n ,  1)— operator s  over  G.  Relative  to 
consideration  (2)  is  the  fact  that  under  the  stated  condi¬ 
tions  on  G ,  there  exist  (n , l)-operators  over  0  that  cannot 
be  synthesized  from  (m, 1)— operators  over  Q  when  m  <  n. 

Also,  he  establishes  that  if  G  consists  of  n  cells,  any 
operator  over  G  can  be  synthesized  from  (1 , 1)— operator s 
and  1— predicates . 

Glebov  also  considers  the  question  of  synthesizing 
operators  over  a  memory  G  from  (m, 1)— operators  by  use  of 
additional  memory  cells.  Let  G  =  [xpX2,..*,xn]  be  a 
given  memory,  the  cells  of  which  admit  of  a  finite  number 
of  states  constituting  the  set  G.  G'  =  ^xn+q-»xn+2 ^  ‘  *  ^n+k^ 
and  G'  =  [0, 1, . . . , s— 1}  denote  the  working  memory  and  states, 
respectively,  and  M(0)  and  M(fi')  represent  the  sets  of 
memory— states  of  G  and  G1,  respectively-  Take  G  =  G  U  G  , 
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n  =  a  U  n\  Then  M(Q)  =  {g  1  g: Q  -  Gjg:Q 1  -  G'}.  Define 
(IT)  =  (gig  €  M(n)Jg(xi)  =  0  for  x^  e  □'}  and  the  mapping 

cj:M(n)  -  M°(Q) 

by  a (g)  =  g  if  g(xi)  =  I(xi)  for  x±  e  Q,  g  e  M(g),  and 
I  €  M°(0)  . 

a  is  a  1—1  mapping  of  M(0)  onto  M^(0)  and  induces  an 
isomorphism  a'  of  the  category  of  operators  over  ft  into 
some  category  of  operators  over  ft,  as  follows.  The 
domain  and  range  of  =  a'A  correspond  to  the  domain  and 

range  of  A  under  a,  and  A*"*  is  such  that  A(g)  A*“*(g)  if 

o  — 
g  ^  g- 

The  problem  now  takes  the  form:  What  are  the  least 
values  of  k  and  s  for  which  any  operator  A^  e  K*“*  can  be 
synthesized  from  an  (m, 1)— operator  (2  <  m  <  n)  over  ft? 

A  partial  answer:  At  least  one  working  cell  is  necessary 
for  synthesis  of  an  operator  A^  €  from  (2, l)-operators 
over  ft  while  a  single  working  cell  (k  =  1)  that  admits 
of  two  states  (s  =  2)  is  sufficient  for  this  purpose. 

2.4.4.  An  Algebraic  Equivalent  of  Synthesis.  A 
method  of  synthesizing  an  operator  over  a  memory  from 
relatively  simple  operators  is  of  potential  value  in  that 
it  is  to  be  expected  that  programming  the  simple  operators 
is  itself  relatively  straightforward,  and  hence  the  method 
presumably  provides  the  means  for  programming  the  more  complex 
operator.  In  his  interesting  paper  [15]  Glebov  develops 
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an  algebraic  equivalent  of  this  situation  and  gives  some 
applications.  The  problem  takes  the  following  form:  given 
an  operatory  category  K  and  a  set  E  c  K,  characterize 
those  members  A  of  K  that  are  representable  as  products 
of  members  of  E.  This  brings  us  to  a  brief  mention  of  the 
subcategories  of  a  category. 

A  subcategory  of  a  category  K  is  said  to  be  proper 
if  every  identity  element  of  K-^  is  also  an  identity  element 
of  K.  It  is  clear  that  the  interaction  of  an  arbitrary  set 
of  proper  subcategories  of  a  category  is  a  proper  sub- 
category  . 

In  treating  the  stated  problem,  we  may  assume  that 
E  contains  no  identity  elements.  By  the  proper  subcategory 
K(E)  generated  by  a  set  E  is  meant  the  minimal  proper  sub- 
category  containing  E. 

It  is  important  to  know  when  the  sets  of  operators 
that  can  be  synthesized  from  two  given  basic  sets  are  the 
same.  This  consideration  leads  to  the  following  defini¬ 
tion:  sets  E-^  and  E2  are  said  to  be  equivalent  if  they 

generate  the  same  minimal  subcategory,  that  is,  if 
K(E^)  =  K(E2)-  To  investigate  the  conditions  under  which 
this  equation  holds,  some  auxiliary  notions  are  needed. 

Suppose  some  operator  category  KQ  is  given,  consisting 

of  operators  A:M-^  -  M2,  where  M^  and  M2  are  subsets  of  some 

r 

set  M  .  We  define  a  subordination  relation  <  on  M„  x  M 

Cfc  LX  LA 

by  these  two  axioms: 
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r  r  r 

(1)  If  f-^  <  f2  and  f2  <  f then  f-^  <  f^- 

(2)  If  f^  <  f 2 ,  then  A(f^)  <  A(f2)  for  any  A  e  Ka 

defined  on  f,  and  f  9 .  An  example  of  such  a  sub- 
i  a  i 

ordination  relation  is  fn  <  f9  if  and  only  if 

1  1  2 

f-^  =  f 2 .  Another  example  is  f^  <  f2  for  all 

<£1-  f2>  e  W 

Let  c  K  .  By  a  quasi— invariant  of  is  meant  any 
r 

f  e  Ma  such  that  Af  <  f  for  all  A  e  7^  •  S  (#£)  designates 
the  set  of  all  quasi— invariants  of  TV(  and  hence 

s(M)  =  ns  (A)  , 

A  eK 

where  S(A)  is  the  set  of  all  quasi— invariants  of  the  operator 
A. 

If  a  is  a  homomorphism  of  a  category  K  into  Ka,  E  <=  K, 
r 

and  R  =  (Ka,  <,  a),  then  the  set  R(E)  =  S(crE)  is  called  the 
R-characteristic  of  E,  and  the  members  of  R(E)  are  called 
q— quasi— invariants ■  These  preliminaries  put  one  in  a 
position  to  define  sets  E-^  and  E2  (each  having  no  identity 
elements)  as  being  R— equivalent  if  R(E-^)  =  R(E2)-  Glebov 
proves  that  E^,  E2  c  K  are  equivalent  if  and  only  if  they 
,are  R-equivalent . 

The  R— characteristic  of  a  set  E  is  a  function  of  the 

r 

operator  category  the  subordination  relation  <,  and 

r 

the  homomorphism  cr-  Thus  for  each  triple  R  =  (Ka,  <,  o) 
we  have  a  possibly  different  R— equivalence  criterion  for  the 
subsets  of  a  category  K.  In  this  connection  Glebov  defines 
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an  R^— criterion  to  be  weaker  than  an  R2— criterion , 

Rl  <  R2  if  any  pair  (E-^,  E2)  of  subsets  of  K  that  are 
R2~ equivalent  are  also  R-j— equivalent .  (One  would  think 
that  Glebov  should  say,  "no  stronger  than,"  but  he  actually 
does  say,  "weaker  than").  As  the  reader  doubtlessly 
anticipates,  an  R-^— criterion  and  an  R2— criterion  are 
equipotent  if  R^  <  R2  and  ^2  —  '  R(K)  denotes  the  set 

whose  elements  are  classes  of  equipotent  R— equivalence 
criteria . 

Concerning  the  structure  of  R(K),  Glebov  proves  the 
following  theorem:  The  set  R(K)  is  a  complete  lattice. 

2.4.5.  An  Example.  Glebov  next  turns  to  an 
application  of  these  ideas.  Consider  a  memory  Cl  consisting 
of  just  three  cells,  x^,  X2 ,  x^,  each  of  which  admits  of 
being  in  state  0  or  state  1.  The  set  M  =  {f}  of  memory- 
states  thus  consists  of  eight  elements.  Consider  the 
operator  category  K  of  all  invertible  operators  A:M  -  M 
and  the  set  E  c  K  of  all  (2 , 1)— operators .  In  this  example, 
K  is  the  symmetric  group  of  order  8,  while  the  subcategory 
K(E)  is  the  subgroup  of  order  81/30  =  1344. 

The  problem  is  to  find  necessary  and  sufficient 
conditions  for  A  e  K  to  be  a  member  of  K(E).  A  theorem 
of  Glebov  [14]  states  that  any  (n ,m)— operator  over  a 
memory  Q,  the  cells  of  which  admit  of  a  finite  number  of 
states,  can  be  synthesized  from  (n , 1)— operators  over  Q. 
Inspection  of  the  proof  reveals  that  if  the  given  operator 
is  invertible,  the  factors  can  be  taken  to  be  invertible. 
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Consequently  K(E)  contains  all  invertible  (2 ,2)— operators , 
and  the  problem  reduces  to  finding  necessary  and  sufficient 
conditions  for  arbitrary  A  e  K  to  be  representable  in  terms 
of  invertible  (2 , 2)— operators .  This  amounts  to  determining 
an  R^-equivalence  criterion  for  category  K  such  that  every 
subcategory  K-^  of  K  that  is  not  contained  in  K(E)  is  not 
R^-equivalent  to  K(E). 

To  this  end  we  represent  the  set  M  by  the  set  M*  = 

{0,  1,  .  ..,  7],  associating  with  state  g  the  number 
3  i-1 

n  =  £  g(x.)2  ,  and  the  members  of  K  can  hence  be  given 

i=l  1 

the  following  cyclic  form: 


Ax  =  (04)  (15)  (26)  (37) ,  A2  =  (145)  (367),  A3  =  (246)  (357), 
A4  =  (05)  (27),  A5  =  (04)  (26),  Afi  =  (01)  (45). 


Glebov  divides  the  invertible  (2 , 2)— operators  into 
three  types,  characterized  by  the  matrices 


T  .  /0123\  ,  x  ,  P45} 

1  \  4567 /  2  \ 2367 / 

and 

t  -  Z  0246' 1 . 

3  V  1357  / 


respectively. 

For  example,  if  A  e  K  and  AT-^  = 


I  A (0)A (1)A (2)A (3)  \ 
\  A  (4)  A  (5) A  (6)  A  (7)/ 
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then  A  is  a  (2 , 2 ) -operator  of  type  I  if  and  only  if  AT^  can 
be  obtained  from  T^  by  means  of  column  permutations  of  the 
above  permutations,  A&  is  a  type  I  operator,  A-^  A2,  and  A^ 
are  type  two  operators,  and  A-^  and  A^  are  type  III. 

Let  E  =  {e}  be  the  set  of  all  subsets  e  of  M'  con¬ 
sisting  of  four  elements,  e  =  [n^,  n2,  n^,  n^}.  The 

O 

cardinality  of  E  is  =  70.  Define  M-^  =  {f}  to  be  the  set 

of  all  subsets  f  of  E  consisting  of  14  elements.  The 

cardinality  of  is  C^.  Take  K-^  to  be  the  category 

generated  by  the  set  of  all  invertible  operators  A'  :M-,  -*  M, 

1  L 

and  define  for  all  f^,  f2  e  ,  f^  <  f2  iff  f^  =  f 2 .  CT^ 
is  the  homomorphism  that  takes  each  A  e  K  to  the  operator 
ct-^A  =  A1  e  K  such  that  A'  takes  f  =  {(n-£^,  n2^,  ..., 
n^^),  ...,  ...,  n^^)}  to  the  elements  f'  = 

{(An-j^,  An^1^),  ...,  (An^1^,  ...,  An^1^)}.  Set 

Rx  =  (Kr  <,  ai). 

Consider  fg  =  {e^,  e2,  ...,  e-^}  e  M^,  where  e^  = 

(0,  1,  2,  3),  e2  =  (0,  1,  4,  5),  e3  =  (0,  1,  6,  7),  e4  = 

(0,  2,  4,  6),  e5  =  (0,  2,  5,  7),  e6  =  (0,  3,  4,  7),  e?  = 

(0,  3,  5,  6),  e.^  =  e'^5_jL  for  i  =  8,  9,  ...,  14.  Let 

K(f0)  be  the  set  of  all  A  e  K  such  that  fQ  is  a  p— < quasi— 

^invariant,  which,  by  definition  of  <  is  the  same  as  requiring 
(aiA)f0  =  fQ- 

Using  these  preliminaries,  Glebov  establishes  that  A  e  K 
is  representable  in  terms  of  (2,2)— operators  iff  fQ  is  a 
quasi— invariant  of  this  operator,  that  is,  K(E)  =  K(fQ) . 
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It  is  obvious  that  in  general  the  setting  and  content  of 
these  papers  are  quite  remote  from  the  practices  of  computer 
programming.  One  cannot  but  share  A.  A.  Lyapunov's  opinion 
that  isolation  of  research  in  programming  from  developed 
branches  of  mathematics  is  undesirable  and  would  probably 
frustrate  a  fruitful  development.  His  selection  of  the  theory 
of  categories  as  the  framework  in  which  to  proceed  because 
of  its  "close  relationship"  to  the  transformations  that  occur 
in  programming  and  his  seeming  expectation  of  big  things  to 
come  is  perhaps  too  sanguine.  The  great  generality  and 
skeletal  nature  of  the  theory  of  categories  certainly  allows 
room  for  some  description  of  programming  but  the  value  of 
such  a  description  is  another  question.  In  fact,  if  one 
looks  at  the  papers  it  is  clear  that  the  depth  into  which 
the  theory  is  gone  is  not  very  great,  and  that  whenever  one 
gets  down  to  cases  (problems),  the  methods  employed  don't 
have  much  to  do  with  categories  but  are,  of  course,  combina¬ 
torial.  It  is  to  be  expected  that  the  value  of  an  approach 
to  programming  via  the  theory  of  categories  will  remain 
largely  on  the  descriptive  level.  It  may  help  to  clarify 
the  structure  of  certain  problem  areas,  but  the  problems 
themselves  that  arise  in  the  development  of  programming 
seem  more  susceptible  to  the  methods  of  mathematical  logic, 
the  theory  of  algorithms,  combinatorics,  and  graph  theory. 

It  will  be  interesting  to  see  if  the  work  of  Glebov  will 
have  applications  perhaps  to  automatic  programming. 
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3.  OTHER  SOVIET  EFFORTS 

3.1  Preliminary  Remarks 

Another  Soviet  effort,  related  to  but  largely  inde¬ 
pendent  of  the  theory  surveyed  in  Part  2,  has  had  to  do 
with  bringing  suitably  modified  versions  of  such  mathemat¬ 
ical  disciplines  as  graph  theory  and  the  theory  of  recursive 
functions  to  bear  on  the  problems  originating  in  computer 
programming.  In  contradistinction  to  the  theory  rooted  in 
the  operator  method,  the  analysis  is  applied  not  to  the 
classes  of  operations  prescribed  by  computer  programs  but 
to  the  classes  of  problems  susceptible  of  programmed  solu¬ 
tions.  The  efforts  do  not  take  the  transformations  recurrent 
in  computer  programming  as  their  main  point  of  departure, 
but  concentrate  on  the  very  notion  of  algorithm,  seeking 
to  adapt  the  well  known  definitions  such  as  Turing  machines, 
normal  algorithms,  etc.,  and  render  them  more  suitable 
instruments  for  studying  the  problems  of  programming.  The 
parent  paper  of  this  development  is  L.  A.  Kaluzhnin's  [18] . 
This  paper  gives  the  results  of  a  seminar  held  in  Kiev  in 
1956  at  the  Mathematical  Institute  of  the  Ukranian  S.S.R. 
Academy  of  Sciences  dealing  with  the  development  of  com¬ 
puters,  and  another  at  Kiev  State  University,  also  in  1956, 
concerned  with  the  theory  of  algorithms  and  mathematical 
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logic.  Principal  descendants  of  [18]  are  Ershov's  [10]  and 
[11 ],  and  Zaslavskii's  [36], 

The  announced  aim  of  [18]  is  the  development  of  general 
methods  of  preparing  mathematical  and  logical  problems  for 
solution  with  a  computer.  In  constructing  a  formalism  to 
this  end,  the  stated  desirable  features  are  as  follows: 

(1)  Formulation  of  the  general  problem  as  a  class  of 
related  problems,  each  of  which  is  described  by  some  word 
on  a  (finite)  alphabet.  The  associated  class  of  words  is 
to  describe  the  class  of  problems,  and  the  words  should  have 
some  common  syntactical  property  that  makes  recognition  of 
them  easy. 

(2)  The  solution  of  the  general  problem  is  to  be  a 
class  of  words  also  characterized  by  certain  syntactical 
properties . 

(3)  Mechanical  rules  applicable  to  initial  words  and 
prescribing  the  transformation  of  these  words  into  solution 
words,  that  is,  words  composing  the  solution  to  the  general 
problem.  The  collection  of  these  rules  may  be  identified 
with  the  algorithm  solving  the  problem. 

(4)  The  algorithm  itself  is  to  be  expressible  as 
words  on  some  enlargement  of  the  original  alphabet. 
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The  entire  structure  possessing  these  features 
is,  as  is  explicitly  stated  in  [  7 ],  a  language .  It  is 
also  noted  that  since  computer  technology  advances  constantly, 
the  language  should  not  reflect  very  closely  the  structure 
of  any  particular  machine,  lest  it  soon  become  out  of  date. 
More  generally,  the  following  are  desirable  objectives  for 
the  language : 

(1)  The  property  of  universality:  the  structure  of 
the  language  should  reflect  the  basic  characteristics  of 
a  modern  computing  machine  without  being  tied  to  any 
particular  machine. 

(2)  Standard  mathematical  and  logical  algorithms 
should  be  readily  expressible  in  the  language. 

(3)  An  automatic  translator  should  be  provided 

that  translates  the  language  into  the  machine  language 
of  the  particular  machine  being  used. 

(The  reader  no  doubt  recognizes  that  the  features 
and  objectives  listed  by  Kaluzhnin  have  been  realized  to  a 
great  extent  in  such  higher  level  languages  as  FORTRAN 
and  ALGOL. ) 

One  may  ask  why  none  of  the  standard  formalisms  of 
the  theory  of  algorithms  would  serve  as  an  adequate 
language.  In  the  first  place,  the  theoretically  desirable 
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atomic  character  of  the  basic  operations  of  the  usual 
formalisms  make  the  computations  of  even  rather  simple 
functions  lengthy  and  tedious.  Again,  in  complex 
problems  the  logical  conditions  frequently  dominate. 

A  satisfactory  language  ought  to  make  the  programming  of 
these  logical  conditions  relatively  easy,  but  the  simplic¬ 
ity  and  economy  of  the  basic  operations  of  Turing  machines, 
systems  of  equations,  and  the  like,  make  the  simulation  of 
these  logical  conditions  a  complicated  task.  In  brief, 
the  very  features  that  make  the  common  formalisms  concep¬ 
tually  attractive  render  them  unpractical  to  be  used  as 
models  of  a  programming  language.  A  discussion  of 
Kaluzhnin's  [18]  follows. 

3.2  The  Graph  Schemes  of  Kaluzhnin 

Let b  be  class  of  finite  directed  graphs  G  such  that 
in  each  G  e^,  the  following  conditions  exist: 

(1)  There  is  a  single  distinguished  node  I,  called 
the  input  node,  of  the  graph  G  such  that  for  all  other 
nodes  a  of  G  there  is  at  least  one  directed  edge  from  I 
to  a ; 

(2)  there  is  exactly  one  node  0  from  which  no  arrow 
(directed  edge)  begins,  the  output  node  of  the  graph; 
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(3)  there  is  a  partition  of  all  nodes  of  G  other 


than  0  into  two  sets  : 

(a)  nodes  of  the  first  kind --those  from  which 
a  single  arrow  exits, 

(b)  nodes  of  the  second  kind --those  from  which 
a  pair  of  arrows  exit,  one  marked  with  a  plus,  +,  the 
other  with  a  minus, 

Suppose  that  a  finite  set  $  =  <¥>2?  ®n]  of 

operators  and  a  finite  set  Y  =  {i  ,  <1^1  of  dis¬ 

criminators  are  given.  A  graph  scheme  r  over  $ ,  Y  is  a 
graph  G  e  n-  in  which  each  node  of  the  first  kind  and  the 


output  node  correspond  to  some  operator  and  each  node 

of  the  second  kind  corresponds  to  some  discriminator  Yj • 

3.2.1  Interpretations  of  Graph  Schemes.  By  an 

interpretation  of  an  §-Y-graph  scheme  is  meant  a  triple 

(M,  §  ->  A,  Y  -*  F),  where  M  is  a  nonempty  set  of  objects, 

$  -*  A  is  a  mapping  of  the  operators  $  onto  the  class  A 

of  mapping  A^.  of  M  onto  itself,  and  Y  -»  F  is  a  mapping  of 

the  class  Y  =  {t!^}  onto  the  class  F  =  [F^ }  of  properties 

of  members  of  M.  Here 

F  =  {me  M|m  has  the  property  F.}, 

J  J 


F.”  =  {m  e  Ml m  doesn't  have  the  property  F.}. 

J  J 


-89- 


A  graph  scheme  r,  together  with  an  interpretation 

(M,  §  -A,  Y  -  F),  defines  an  algorithm  in  the  set  M  as 

follows:  A  sequence  m^  =  m,  m^,  m2 , • • • ,  m^, . . .  is  defined, 

and  simultaneously  with  each  m^  there  is  associated  a  node 

of  the  graph.  Accordingly,  m^  =  m  and  is  associated  with 

the  node  I.  Suppose  ,  m^,  ...,  m^,  k  >  0,  have  been 

defined  and  associated,  respectively,  with  I  =  n^ ,  n^, 

.  .  .  ,  n.  .  If  n.  is  a  node  of  the  first  kind  and  m.  cor- 

responds  to  n^,  then  m^+^  =  A^  (m^.),  and  is  associated 

with  the  node  n.  . ,  connected  with  the  arrow  exiting  from 
k+1 

n,  .  If  n,  is  a  node  of  the  second  kind  and  discriminator 
k  k 

\!i^  corresponds  to  n^,  then  m^+^  =  m^;  and  if  m^eF^.  ,  then 

n,  ,  is  the  node  connected  with  n.  by  the  exiting  plus 
k+1  k. 

arrow.  If  m^eF^.-,  then  n^^  is  the  node  connected  with 

the  n^  by  the  exiting  minus  arrow.  If  n^  =  0,  then  the 

procedure  terminates,  m^.  =  r(m),  and  m^.  is  said  to  be 

the  result  of  applying  r  to  m. 

Graph  schemes  naturally  lend  themselves  to  pictorial 

representations.  Here  are  some  very  simple  examples. 

I 

1. 


+ 

y 
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Here  £  =  0  and  y  =  It  is  clear  that  given  any  inter¬ 

pretation  (M,  I  -  A,  Y  -*  F)  ,  every  m  e  M  is  transformed  into 
itself  if  m  has  the  property  F,  whereas  r(m)  is  undefined 
if  m  does  not  have  the  property  F. 

2.  I 

V/  rn 

6 

\  Here  Y  =  0,  §  =  {<p}.  Apply  the  operator  cp. 


3. 


I 


XT 

i'i 


+ 


o 


Conditional  iteration  of  operator  co-^  -  is  applied 
until  the  current  element  satisfies  property  F. 
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Here  Y  =  £  ilr } ,  $  =  {cp^,  cp2}.  Apply  to  m  e  M  the  operator 
cp^  or  cp2 ,  according  as  meF^~*~  or  meF-^  . 

5.  An  interpretation  (M,  §  -*  A,  y  -*  F)  is  called  Markovian 
if 


(1)  M  is  the  set  of  all  words  on  a  given  finite 
alphabet . 

(2)  All  F.  are  properties  of  the  type  F  ,  where  F 

J  xx 

denotes  the  property  that  some  word  contains  at  least  one 
occurrence  of  the  word  x. 

(3)  All  A^  are  operations  of  the  type  A^  , 

where  A  stands  for  the  substitution  of  the  word  y 

x  -»  y  y 

for  the  first  (left-most)  occurrence  of  the  word  x  in  the 
word  A. 

Let  §  =  {cp^5  ...j  9n3  and  y  =  { \j/ *  1  determine 
a  graph  scheme.  Consider  the  normal  algorithm  over  some 
alphabet  having  the  scheme 
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Taking  cp  ->  A  .  ->  Y,  ,  i .  -A  .  as  the  members  of  $  -*  A  and 

J-  XL  JL  X.  XL 

Y  -*  F,  respectively,  the  graph-scheme  representation  of 
the  given  normal  algorithm  is 
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3.2.2  The  Equivalence  of  Graph  Schemes.  Kaluzhnin 
offers  two  notions  of  equivalence  for  graph  schemes.  The 
first  and  obvious  definition  depends  on  a  given  interpreta¬ 
tion.  Graph  schemes  and  are  equivalent  with  respect 
to  (M,  §  ->  A,  Y  ->  F)  if  for  all  m  in  m,  T^(m)  is  defined 
exactly  when  ^(m)  is,  and  in  that  case  T^(m)  =  r^Cm)  . 

The  second  definition  is  independent  of  the  interpretation, 
and  reminds  one  of  Yanov's  definition  of  equivalent 
algorithm  schemes.  Thus,  and  r 2  are  strongly  equivalent 
if  for  all  interpretations  the  algorithms  defined  by 
and  r 2  are  equivalent  in  the  first  sense. 

Kaluzhnin  also  mentions  the  operation  of  substituting 
of  one  graph  scheme  into  another,  with  a  view  toward 
developing  an  "algorithm  algebra."  Suppose  and 
r2  are  given  §-Y-graph  schemes.  By  the  substitution  of 
r2  in  is  meant  the  substitution  of  r2  for  each  occurrence 
of  an  operator  cpg  in  omitting  the  input  and  output  nodes 
of  r2.  The  result  of  this  substitution  is  itself  a  §-'f- 
graph  scheme.  In  this  connection,  Kaluzhnin  notes  the  desir¬ 
ability  of  a  substitution  operation  that  could  be  applied 
to  discriminators  as  well  as  operators.  To  accomplish  this, 
he  suggests  extending  the  notion  of  a  graph  scheme  by 
providing  for  two  outputs  0+  and  0~,  arriving  at  graph 
schemes  of  the  second  kind.  However,  he  observes  that  if 
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a  graph  scheme  F  of  the  second  kind  is  substituted  for  an 
occurrence  of  a  discriminator  Y^  the  outputs  o"*"  and  0 
of  F  will  be  not  m  but  r (m) .  Thus  at  Y .  there  occurs 

l 

not  simply  a  decision  but  a  transformation.  As  a  way  out, 
he  suggests  the  introduction  of  memory  elements  into  the 
notion  of  a  graph  scheme.  Accordingly,  in  substituting  a 
graph  scheme  of  the  second  kind  for  an  occurrence  of  a 
discriminator,  the  element  m  is  to  be  placed  in  the 
memory  and  restored  at  that  one  of  the  outputs  0+  and  0 
at  which  it  would  ordinarily  appear.  He  concludes: 

"The  problem  as  to  the  most  rational  way  of  introducing 
such  memory  elements  into  the  graph-scheme,  while  preserving 
the  possibility  and  meaning  of  the  substitution  operation, 
is  an  important  but  as  yet  unsolved  question."  This 
consideration  forms  the  basis  for  the  paper  of  Zaslavskii 
[36]. 


3.3  The  Operator  Algorithms  of  Ershov 

3.3.1  Motivation  for  the  Definition.  Ershov's  [10]  and 
[11]  on  operator  algorithms  represent  an  attempt  to  adapt 
the  Markov  normal  algorithm  formalism  for  rendering  the 
theory  more  applicable  to  computer  programming,  and,  in 
particular,  for  constructing  more  adequate  programming 
languages.  In  [ll],  a  reformulation  of  the  basic  concepts  of 
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the  theory  is  carried  out,  and  in  [11],  applications  are 
discussed.  Such  a  reformulation  has  been  precipitated  as 
a  result  of  the  development  and  use  of  compilers.  Ershov 
finds  the  following  problems  among  the  more  outstanding. 

(1)  Narrowing  the  distance  between  the  language  in 
which  an  algorithm  is  to  be  programmed  and  the  rather  formal 
language  in  which  the  problem  is  presented  to  the  compiler. 

The  dissimilarity  between  the  initial  description  of  an 
algorithm  and  that  of  logical  schemes  has  been  a  particu¬ 
larly  important  factor  in  causing  the  passage  from  one  to 
the  other  to  be  lengthy  and  time  consuming. 

(2)  Developing  a  measure  of  the  quality  of  an  algo¬ 
rithm,  or  of  different  realizations  of  some  general  algorithm, 
to  facilitate  optimal  programming  by  selecting  the  best 
realization  from  a  class  R  of  algorithms  that  are  equivalent 
(in  some  suitable  sense).  In  this  connection  it  is  impor¬ 
tant  to  "know"  the  class  R  as  completely  as  possible  by 
constructing  a  calculus  of  transformations  generating  the 
members  of  R. 

(3)  Developing  methods  by  which  the  equivalence 
of  algorithms  can  be  effectively  recognized.  The  most 
general  instance  of  this  problem  has  been  shown  by  H.  G.  Rice 
to  be  recursively  unsolvable  [30].  The  problem  thus 
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becomes  that  of  examining  various  definitions  of  "equiva¬ 
lence,"  hoping  to  isolate  those  which  make  the  question  of 
equivalence  effectively  decidable,  and  yet  are  sufficiently 
broad  to  include  as  equivalent  a  generous  portion  of  those 
algorithms  that  would  be  expected  to  be  equivalent  on 
basic  or  working  grounds. 

On  the  basis  of  the  above,  Ershov  lays  down  the 
following  requirements  for  a  formal  language  to  describe 
algorithms : 

(1)  The  definition  should  comprise  a  rich  class  of 
elementary  operations  in  contrast  to  the  atomic  character 
of  the  components  of  the  theoretical  formalisms. 

(2)  The  definition  should  allow  for  the  "instructions" 
of  an  algorithm  to  be  developed  in  the  course  of  its 
operation,  as  is  the  case  with  computer  programs. 

(3)  The  language  should  be  flexible  enough  to  reflect 
the  features  of  particular  classes  of  problems.  For 
example,  the  problems  of  linear  algebra  should  be  described 
in  terms  of  the  field  operations.  Thus,  the  definition  of 
an  algorithm  should  allow  both  the  form  of  the  information 
to  be  processed  and  the  means  by  which  it  is  processed  to 
vary  with  the  class  of  algorithms  considered. 
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Ersov  is  the  author  of  "Programming  Program  for  the 
BESM  Computer"  [6],  defining  a  compiler  based  on  the 
operator  method  of  programming.  These  earlier  efforts 
account  for  retention  of  the  word  "operator"  in  "operator 
algorithms,"  but  there  is  another  relationship: 

From  the  structural  point  of  view  the  basic 
characteristic  feature  of  logical  schemes  is  that 
an  algorithm  is  represented  in  the  form  of  a  list 
of  information  processing  operators,  all  the 
transitions  from  one  operator  to  another  being 
indicated;  the  selection  of  one  out  of  the  sev¬ 
eral  possible  transitions,  depending  on  the 
results  obtained,  is  carried  out  by  logical 
operators.  This  feature  is  retained  entirely 
in  our  proposed  definition  of  operator  algorithms 

3.3.2  The  Definition  of  Operator  Algorithms.  The 
syntactic  classes  of  Ershov's  definition  are  those  of 
variables,  operations ,  formulas ,  and  operators .  In  each 
case,  the  members  of  the  classes  are  words  on  some  alphabet. 
It  is  understood  that  this  alphabet  always  includes  the 
symbols  ( ,  ) ,  =£>  ,  and  *.  For  each  class  of  operator 
algorithms,  the  class  of  variables  is  a  recursive 
subset  of  the  set  W  of  all  words  on  the  alphabet  of  the 
class.  Variables  are  denoted  by  lowercase  roman  letters, 


with  or  without  subscripts: 

a,  b,  c,  d,  n,  x,  y,  z,  x^,  y^,  z^,  .  . 


.  etc . 


-98- 


The  possible  values  of  the  variables  also  constitute  a 
recursive  subset  of  W.  In  general  the  specification  of 
the  set  if  of  variables  is  to  include  mention  of  the  possible 
values  of  the  variables.  Intuitively  speaking,  variables 
are  to  serve  as  the  addresses  of  memory  locations  of  a 
computer,  and  the  values  of  these  variables  as  the  contents 
of  the  locations. 

A  k-place  operation  is  a  word  of  the  form 


A0(  )A1(  )...(  )Ak, 

where  Aq,  A^,  . . . ,  A^  are  words  on  the  given  alphabet. 

It  is  understood  that  the  subalphabet  of  the  alphabet  of 
the  operator  algorithm  in  which  the  variables  V  and  the 
words  Aq,  . . . ,  A^  are  written  does  not  contain  any  of  the 
symbols  (,  ),  ,  and  *.  The  result  of  applying 

Aq(  )Al(  )•••(  )Ak  to  words  n^  n2 ,  .  -  .  ,  nfc  is 
written  A^n^A^n^  .  .  .  (nk)Ak- 

In  presenting  a  class  of  operator  algorithms,  a 
finite  list  £  of  operations  is  given.  The  list  corres¬ 
ponds  to  the  "order  code"  of  a  computer,  that  is,  to  the 
selection  of  elementary  operations  with  which  a  program 
is  composed. 

The  notions  of  expression,  arguments  of  expressions, 
and  values  of  expressions  for  a  given  selection  of  argument 


values  are  simultaneously  defined  by  induction: 
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(a)  Any  variable  x  e  is  an  expression,  and  x  is  the 
argument  of  x.  If  a  is  a  value  of  the  variable  x,  a  is  a 
value  of  the  expression  x. 


(b)  Let  Aq(  )A-l(  )•••(  )Ak  be  a  k-place  operation 

of  and 


Tl(xll’  x12 ’ 


x.  )  ,  .  .  .  ,  T,  (x.  ,  ,  x.  „  , 
i_n^  kv  kl  kz 


V  > 

k 


be  expressions.  The  word  T  obtained  by  substituting  in 


the  i-th  place  of  the  operation  Aq(  )A^(  )  •  •  •  (  )A^ 

the  expression  T .  (x^ ,  x^2  >  •  •  •  >  )  (i  =  1,  2  ,  k), 

i 

name ly 


Ao(Ti(xii’ 


’  Xln1))  ‘  ‘  •  (Tk^Xkl’  Xkn.))Ak’ 

k 


is  an  expression  with  arguments  x^ ,  x2 >  •••,  x  ,  where 
x2  ’ 


x-,  ,  x„  ,  x  constitute  all  those  variables  that  are 


n 


arguments  of  the  expressions  T^.  Let  a^,  a2 , 

a  be  the  values  of  x, ,  •••,  x  .  Each  a  (t  =  1,  2,  n) 

n  l  n  t 

is  some  a^^  (1  <  i  <  k;  1  <  j  <  n^). 


If  T]_(a11, 


ai-  )  N  >  ^9  (a  91  ■> 


Tk^akl ’  ak2 ’ 


’  aknn 


Lln1y  U1 


r  x.  '2 v  21  ^l,2 

)  =  b^  and  AqO^)  .  .  .  (bt)At  =  b,  the 


a0_  )  —  b0 , 


2n 

'k'Ak 


expression  T  has  the  value  T(a^,  a^),  and  T(a^, 

a  )  =  b. 
n 

A  formula  is  a  word  of  the  form 


T(xx 


where 


x2’  ■■■’  xn>  => 

is  the  sign  of  correspondence,  T(x^,  . . . ,  x  ) 


is 
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an  expression,  and  y  is  a  variable.  The  variables  x^,  x^ , 

. . . ,  xn  are  called  the  input  variables  of  the  formula,  and 
y  is  the  output  variable. 

An  operator  is  any  word  of  the  form 

T1  yx  *  T2  =>  y2  *  •  •  *  *  Tm  ym’ 
where  m  >  0,  and  Ti==2>  y^  (i  =  1,  2,  m)  are  formulas. 

It  is  the  operators  that  are  the  basic  building  blocks 
of  operator  algorithms.  They  are  the  formal  analogue  of 
the  instructions  of  a  computer  program.  In  an  operator 
algorithm,  the  operators  occur  as  the  values  of  certain 
variables,  to  be  termed  the  operator  variables.  Thus, 
in  any  operator  algorithm  certain  variables  must  be 
designated  as  the  operator  variables. 

Suppose  that  classes  and  £  of  variables  and  opera¬ 
tions  on  some  alphabet  are  given.  A  word  n^ ,  distinct  from 
all  the  variables,  is  set  aside  to  identify  a  STOP;  r  +  s 
variables  p^,  ...,  p^ ,  x^ ,  ...,  xg  of  U'  are  selected,  the 
p^,  . . . ,  p^  serving  as  the  parameters  and  the  x^ ,  x^,  • ■ • , 
x  as  the  functional  variables  of  an  operator  algorithm. 
Associated  with  p^,  ...,  p^  are  designated  values  ,  ..., 
q  .  From  among  the  parameters,  one  variable  p*  is  selected 
as  the  start  variable.  Finally,  a  choice  of  functional 

variables  x,  ,  x„ ,  . . . ,  x  and  parameters  p1 ,  . . . ,  p  with 
a  start  p*  and  values  q^}  ...,  q*  is  an  operator  algorithm 
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Q_  from  the  class  of  operator  algorithms  CLOTS',  on  the 
variables  XT  and  operations  JT. 

3.3-3.  The  Execution  of  an  Operator  Algorithm. 

The  execution  of  an  operator  algorithm  is  to  be  conceived 
in  terms  of  the  operating  region  of  the  algorithm. 

This  region  consists  of  certain  variables,  together 
■with  the  values  of  these  variables.  The  effect 

of  operation  of  the  algorithm  is  to  transform  the  oper¬ 
ating  region.  As  a  result  of  this  transformation,  the 
values  of  some  variables  in  the  operating  region  are 
changed,  and  new  variables,  together  with  their  values, 
are  added  to  the  operating  region.  The  acts  of  the 
algorithm  by  which  these  changes  are  effected  reduce  to 
four:  (a)  transition  to  a  variable,  (b)  execution  of  an 

operator,  (c)  normal  stop,  (d)  stop  without  result.  Of 
these,  (b)  is  the  most  important. 

A  condition  for  the  start  of  the  algorithm  CL  is  that 
the  function  variables  x1 ,  x2 , . . . ,  xg  be  assigned  the 
values  a^ ,  a2  , .  .  .  ,  a  ,  the  initial  data  of  the  algorithm 

a . 

r  Initially,  the  operating  region  of  CL  consists  of  the 
variables  x^ ,  x2,...xg,  pp  .  .  .  ,  pg  and  their  values 

» •  •  •  ,  ,  •  •  •  ,  c[  . 

Step  1.  The  start  variable  p*  belongs  to  the  oper¬ 
ating  region  of  CL  • 
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Step  k+1.  Suppose  that  k  steps  have  been  performed 
and  that  the  k-th  step  has  resulted  in  a  transition  to  the 
variable  y  in  the  operating  region  and  the  present  value 
of  y  is  b. 

Case  1.  b  is  not  an  operator.  The  process  terminates 

in  a  stop  without  result. 

Case  2.  b  is  an  operator  T.  =»  y-.*...*T  =>  y  . 

-  1  1  m  m 

Let 


•Zn> 


be  the  i-th  formula  of  the  operator,  i  =  1,2,...  n,  with 

variables  z, ,  z„  ,  .  .  .  ,  z  .  If  any  of  z15  z0  ,  . . . ,  z  is  not 

included  in  the  operating  region,  the  procedure  terminates 

in  a  stop  without  result.  On  the  other  hand,  suppose  all 

of  z^,...,  occur  in  the  operating  region  with  values 

v, ,  v_ , . . . ,  v  .  If  T.(v-,...v  )  is  undefined  or 
1’  2  ’  ’  n  l  1  n 

T.(v, .....  v  )  =  v  and  v  is  not  an  admissible  value  of 
i  1  n 

y^,  the  procedure  terminates  in  a  stop  without  result.  If 
T.(v v  )  =  b.,  and  y.  does  not  belong  to  the  oper- 
ating  region,  y^  is  added  to  the  region  with  assigned  value 
b^;  if  y^  already  is  a  member  of  the  region  with  value 
b^*,  then  b^*  is  replaced  by  b^.  This  procedure  is 
carried  out  successively  for  i  =  1,  2,...,  m.  It  is  under¬ 
stood  that  if  for  any  =  y ,  the  replacement  of  b  by  b^ 
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is  made  after  the  procedure  has  been  carried  out  for 
i  =  1,  2,...,  m. 

If  b  ,  the  value  of  ym>  equals  n^ ,  the  procedure 

comes  to  a  normal  stop  with  the  result  being  the  values 

of  all  variables  belonging  to  the  operating  region  of  Q. 

If  b  ^  n„  and  either  b  is  not  a  variable  or  b  =  y  and 
m  0  m  m 

y  is  not  in  the  operating  region,  the  procedure  termi¬ 
nates  in  a  stop  without  result.  If  b  -  y  and  y  is  in 
the  operating  region,  there  occurs  a  transition  to  the 
variable  y,  and  the  next  step  is  executed. 

An  algorithm  Ct  with  parameters  p-^,  ...,  pgJ 

functional  variables  x-  ,  .  .  .  ,  x  , and  initial  data 

s 

di,...,  dg  is  represented  as 

P-j^  J  q^  >  P2  ^2  ’  *  ■  *  ’  Pj-  ’  ^1  J  ^  >  xs  Jds’ 

where  it  is  understood  that  and  are  not  members  of 

the  alphabets  in  which  the  variables  or  the  values  of  the 
variables  of  the  class  of  algorithms  are  written. 

3.3.4  Examples. 

1.  Algorithms  of  the  class  The 

alphabet  consists  of  the  Arabic  numerals.  The  numerals 
representing  even  numbers  different  from  zero  are  called 
numerical  variables.  The  values  of  the  numerical  variables 


are  the  natural  numbers.  The  representations  of  the  odd 
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numbers  and  0  are  called  operator  variables.  Their  values 
are  words  on  the  alphabet  +  P,  (,),*,  =*  }• 

The  list  consists  of  the  following  two  operations: 

(a)  (  )  =  1,  where  (p)  +  1  =  P  +  1; 

(t>)  P  (()()),  such  that 


P  ((p-l)-^))  = 


f  1  if  PL  <P2, 

L  0  if  n1  >  p2, 


where  p,p^,  and  P2  are  natural  numbers. 

An  algorithm  for  addition: 

oju  =>  s;  1  Jv  =>  s;  3*  Jt  =>  q*r  =»  s; 

5  JP(y,q)  =*  s;  7  Jx+1  =»  x*q+l  =>  q*r  =*  s; 
v  J2 ;  t  JO;  r  J5;  u  J7 ;  x  J;  yj. 

The  only  functional  variables  here  are  x  and  y. 

Given  initial  data  d^,  62,  we  will  compute  2  +  1  as  follows, 


Transition  Variable 


Operating  Region 


=  (0,l,3*,5,7,v,t,r,u,x,y} 


R  u  [q,s} 
o 


6 


1 
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Result  =  {u  =*  s,  v  =>  s,  t  =>  q*r  =*  s,  P(y,q)  =*  s, 
x+1  =>  x*q+l  =>  q*r  =”  s, 2, 0,5, 7, 3, 1,1, 2}. 

An  algorithm  of  class  CLQ/'^,  for  multiplication 

0  Ju  =>  s;  1  Jv  =>  s;  3*  JtQ  =>  z*t q  =■  k*t  =■  s; 

5  J(t  +1)+1  =»  u*t2  =*  v*P(y,k)  =*  s;  7  JtQ  1:5  p*k+l  =  k 
*(  ( (t5+l)+l)+l)+l  =>  s;  9  J(s+1)+1  =»  u*t5  =»  v*P(x,p)  =>  s; 
lljz+l  =•  z*p+l  =>  p*(((t  +1)+1  =>  s;  tgjo,  t2J2; 
t^J4;  t5J5;  xJ  ;  y _J  . 

For  any  initial  data  d^,  d2,  the  value  of  the  variable 
z  after  application  of  this  algorithm  is  d^ • d2 . 

2.  The  class  The  variables  l/^  are 

words  on  the  alphabet  {[},  with  the  proviso  that  the  word 
)l  signifies  STOP.  Words  of  length  n  on  {1}  are 
abbreviated  as  1°;  and  as  well  as  A,  represents  the 

empty  word.  The  values  of  the  variables  are  words  on  the 
alphabet  A  =  t  ,  .  .  .  ,  where  A  indicates  T,R,S,  ,(,),*,=>. 

The  list  of  operations**^,  consists  of  2t+l  operations, 
where  t  is  the  number  of  letters  in  A. 

Let  P  be  an  arbitrary  word  on  A. 

(a)  The  operation  T(  ),  such  that 
T(p)  =(P'  if  P  =  IP 1 (leA) , 

(A  if  P  =  A- 

(b)  t  operations  of  the  form  R]1(  ),i=l,...,t 


such  that 
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R! 1 (P)  =  a.-P 

(c)  t  operations  of  the  form  S|1(  ),  i  =  1, 
such  that 


*  S  t  y 


sl^p)  = 


\  if  P  =  a. -P' , 

l  ’ 

A  if  P  f  a. -P' . 

i 


A  noteworthy  difference  between  the  algorithms  of 
classes  and  is  this:  those  of 

dar2,£2)  have  the  capability  of  generating  operators 
while  the  only  transformations  of  operators  that  are 
performed  by  those  of  are  the  relatively  simple 

ones  of  the  form  x  =*  y. 

Here  is  one  algorithm  of  the  class  £L(X/^,  that 
inverts  a  nonempty  word  and  sends  the  empty  word  into 
itself.  The  following  abbreviations  are  employed: 

S  (  )  stands  for  sl"L(  ), 
a . 
x 

R  (  )  stands  for  R^C  ). 
a . 

1 

If  is  a  nonnull  word  on  A, 

1  n  ’ 

R  .  .  .  g.  (x)  stands  for  Rg.  (R^  ( .  .  .  (R^  (x) )...)), 

S1  n  1  s2  n 

Tn(x)  stands  for  T(T( . . .T(x) . . . )) 


n  T's. 
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The  algorithm: 

|°JlU=>s;  |  J|V  =>  s;  l3*  JzQ  =»  y*z4  =>  s;  |4  Jrx  =»  k*r2  =»  l5 

*r3  =»  |6*z5  =»  s;  l 5  J  l  ^  =»  \u*\m  =*  iv*s|(x)  =*  s; 
l6  jRi  (y)  -  y*T(x)  -  x*Z/  -  s;  |  7  j  T<i-hrhHv+5)  (  |  5}  „  [5 


tR 


r*!m  -  iv*s|(|5)  -  |5*t(|6)  -  i6*^!6)  -  l6*T(k)  -  k 


;  u 


*z^  =>  l  *z2  =» 

1 1  „  [  u  i  ro  |  v 

r2 II*  l  '"I  ^  I  “ <->  i  v /  •"> »  -*-2 

zqJa;  z2J12;  z^JI4;  z5J|5;  xj. 


|V*S  (k)  =>  s;  |  4  J  1  7  ;  |mJ|6;  r,  J  1  Ca  (  eA,  al  1 ) 

cl  J- 

*S|(x)  =  s;  r,  JRl(y)  =»  y*T(x)  =»  x*z,  =>  s; 


3.3.5.  The  Value  and  S -Representation  of  an  Operator 
Algorithm.  Ershov,  in  the  manner  of  Yanov,  takes  the  value 
of  an  algorithm,  given  some  initial  data,  to  be  the  sequence 
of  operators  performed  in  order  of  execution;  that  is,  if 
algorithm  0.  is  applicable  to  initial  data  d^,...,dg,  and 
there  results  the  execution  of  operators  n^,...,n^,  the 
word  n^*n2*...*n^  is  the  value  of  a.  for  d^ , d2 , . . . , dg . 

The  value  of  the  algorithm  for  addition  of  0.(1/^,  <£-^)  for 
y  =  3,  arbitrary  x  is 

t  =»  q*r  =>  s*P(y,q)  3  s*u  35  s*x+l  *•  x*q+l  =>  q 


*r  ^  s*P(y,q)  s*u  m  s*x+l  ^  x*q+l  =>  q* 
r  5=5  s*P(y,q)  ^  s*u  **  s*x+l  x*q+l  ^  q* 

r  =>  s*P(y,q)  =*  s*v  =»  s. 

Suppose  an  operator  algorithm  Q  from  the  class 

with  functional  variables  x^  ,  .  .  .  ,xg  is  given.  : 

By  the  function  realized  by  relative  to  ye  'Z/' as  meant 
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the  function  y ^ (x^ , . . . ,xg)  defined  for  exactly  those  s 
tuples  (d.  , .  .  .  , d  )  to  which  ^  is  applicable  and  such 
that  when  defined  y^  (d^ ds)=b,  where  b  is  the  value 
of  y  at  completion  of  the  application. 

A  distinctive  feature  of  Ershov's  treatment  is  his 
notion  of  the  S—  representation  of  a  value  of  an  operator 
algorithm.  The  motivation  behind  this  notion  seems  to  be 
as  follows.  In  running  a  program  on  a  computer  it 
frequently  happens  that  we  are  interested  in  certain 
intermediate  results  obtained  in  arriving  at  the  "answer." 
On  the  other  hand,  much  of  the  information  processed  in 
such  a  run  is  of  little  or  no  interest.  Correspondingly, 
certain  of  the  variables  present  in  the  value  of  an 
operator  algorithm  play  an  essential  role  in  the  calcula¬ 
tion,  while  others  play  a  merely  transitional  role.  In 
defining  the  S — representation  of  a  value,  one  seeks  to 
isolate  the  more  important  variables. 

Let  Z  be  a  value  of  algorithm  a.  ,  and  let 
F(x^ ,X£ , . . . ,x  )  ^  y  be  the  leftmost  formula  such  that  its 
output  variable  y  is  the  input  variable  for  another  formula 
of  Z  to  the  right  of  F  “  y.  Let  Z'  be  that  part  of  Z  to 
the  right  of  F  s  y  and  Z  that  part  of  Z'  bounded  on  the 
Fight  inclusively  by  the  first  formula  of  Z  to  the  right 
of  F  s  y  which  has  y  as  an  output  variable. 


To  obtain 
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the  word  Z from  =  Z,  all  occurrences  of  y  as  an  input 
variable  in  formulas  of  Z ^  are  replaced  by  F(x^ , . . . jX^) 
and  if  Z'^Z  ,  the  leftmost  F(xn , . . .  ,x  )  =*  y*  is  deleted 

y5  1  ’  n 

from  Z.  This  procedure  is  repeated  until  a  word  Zv  is 
arrived  at  in  which  all  formulas  of  the  form  F  ==>  y,  where 
y  is  an  input  variable  of  some  formula  to  the  right  of 
F  35  y,  have  been  eliminated.  Finally,  all  formulas  of 
Z^m^  having  the  same  output  variable  except  the  rightmost 
are  deleted  and  the  result  is  the  S — representation, 


S  ,  of  Z.  For  each  variable  y  occurring  in  Sz,  there 
is  exactly  one  formula  of  the  form  F(p.  ,...,p.  ,x. 

-L  n  1  a  J  i 


j i  Ji 


x  .  )  53  y  where  p .  , .  .  .  ,p .  ,  x  .  , .  .  .  ,x  .  occur  among  the 

Jm  H  J1  Jm 

parameters  and  functional  variables  of  algorithm  . 

If  Z  is  a  value  of  algorithm  0^  all  variables 
occurring  as  output  variables  in  formulas  of  Z  are  called 


resulting  variables.  A  formula  F  =*  y  of  is  called 

the  S —  representation  of  the  resulting  variable  y. 

The  function  of  the  S — representation  of  a  variable 

is  brought  out  in  the  following. 

THEOREM.  Let  F(p.  ,...,p.  ,x .  ,...,x.  )  a  y  be  an 

11  xl  21  Jm 

S-  representation  of  the  resulting  variable  y  for  a  value 
Z  of  algorithm  0.  ,  given  initial  data  d-^,...^  .  Then  if 
(x^,...,x  )  is  a  function  realized  by  Q  . 
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% 


( d.  s  • •  •  , d  )  F(q.  » • • • , q .  >  d  ) 


V  J1 


ID 


where  q  ,  ...„q.  are  the  initial  values  of  the  parameters 
r! 

p  ...,p  of 
1  l 

The  S -representation  of  the  value  of  the  above 
algorithm  for  addition  when  y  =  3  is 

Sz  =  (((x)  +1)  +  1  ■»  x*(((t)  +  1)  +  1)  +  1)  ■*  q*v  *  s. 

3.3.6  Operator  Algorithms  and  Graph  Schemes.  Con¬ 
sider  a  class  of  operator  algorithms  such  that 

among  the  operations  of  a  there  is  at  least  one  test 

operation ,  which  upon  application  results  in  one  of  two 

+ 


operator  variables,  n  '  or  n  . 

A  class  of  graph  schemes  is  associated  with 

<£?  ( in  the  following  manner.  The  operators  of  Z/'e^') 
defined  over  Z^and  plus  a  null  operator,  constitute  the 
operators  of  the  graph  scheme.  Those  formulas  T  ^  y  such 
that  T  is  a  test  operation  to  be  applied  to  expressions 
serve  as  the  discriminators  of  To  complete  the 

definition,  it  is  stipulated  that  associated  with  each 
member  of/^(2/^c20  is  certain  initial  information,  con¬ 
sisting  of  parameters  p^,...,p  with  assigned  respective 

values  q, , . . . , q  and  functional  variables  x, ,...,x  . 

nl  n:  1  5  s 

To  relate  the  execution  of  a  graph  scheme  of 
to  that  of  an  algorithm  of  (  7/^,  oZ^)  note  that  the  result 
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of  applying  a  discriminator  of  the  former  is  understood  to 
be  a  plus  if  application  of  the  corresponding  operation  of 
the  latter  has  resulted  in  n+,  and  minus  if  application 
has  resulted  in  n  .  The  syntactic  definitions  of  operating 
region,  value  of  a  graph  scheme,  the  S — representation  of 
resulting  variables,  the  functions  realized  by  a  graph 
scheme,  etc.,  can  now  be  given.  To  complete  the  comparison, 
we  define  an  algorithm  ^  to  be  of  zero  rank  if  all  operator 
variables  of  0^.  occur  among  the  parameters  and  if  upon 
application  of  ^  the  values  of  the  operator  variables 

remain  unchanged  throughout  the  application. 

For  example,  a  graph  scheme  of  the  previously  given 
algorithm  in  for  multiplication  is  shown  in  Fig.  1. 

the  following  figure. 

After  these  lengthy  preliminaries,  Ershov  proves  the 
following 

THEOREM.  For  any  graph  scheme  &  e  £)  with 

functional  variables  x-^, .  .  •  ,xg,  there  is  an  operator  algorithm 
of  zero  rank  with  the  same  functional  variables 

such  that  for  the  set  of  initial  data  d-^,  d2 •  •  •  jdg  if  y  is. 
rthe  resulting  variable  of  the  graph  scheme and  has  an  S— 


representation  y,  then  y  is  a  resulting  variable  of  a  and  for 

the  same  set  of  initial  data  has  an  S— representation  F^  =>  y 
such  that 
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By  use  of  this  theorem  and  much  bookkeeping  he  proves: 

( 1)  A  function  cp  is  partial  recursive  if  and  only  if 
it  is  realized  by  an  algorithm  of  o£arvJ^} 
(actually  Ershov  proves  a  weakened  version  of  the 
"if"  part  of  this  theorem).  Here  CC is 
the  subclass  of  0.  consisting  of  algorithms 
of  zero  rank. 

(2)  For  any  normal  algorithm  in  alphabet 

A  =  {a^,...,a  }  where  -*  and  •  are  not  in  A,  there 

•X. 

is  an  algorithm  CL  of  ax  tr,  zj  with  one 
functional  variable  x  and  with  a  resultant  variable 
y  such  that 

: :  y ^  *(x)  » 

where  ~  denotes  strong  equality  and  CZ(x)  is  the 
word  function  defined  by  CL  such  that  C2(P)  =  Q 
is  the  result  of  applying  ^to  P,  where  P  and  Q 
are  words  on  A. 

Two  points  one  notices  about  Ershov's  reformulation  of 
the  notion  of  algorithm  are  its  breadth  and  elegance.  His 
efforts  are  very  reminiscent  of  the  work  of  Wang  [34], 
Minsky  [25],  and  Shepherdson  and  Sturgis  [32],  in  which  the 
theory  of  Turing  machines  is  redone  to  effect  a  rapproche¬ 
ment  between  theory  and  practice.  In  part,  however, 
these  later  papers  are  concerned  with  demonstrating  that 
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various  combinations  of  rather  special  logical  operations 
and  arithmetic  functions  suffice  for  the  computation  of 
all  partial  recursive  functions.  To  put  it  another  way, 
it  is  shown  that  some  machines  obtained  by  crippling  and/or 
modifying  a  Turing  machine  in  some  peculiar  manner  are 
universal.  For  example,  in  the  paper  of  Shepherdson  and 
Sturgis  t32],  one  aim  is  to  modify  the  definition  of 
Turing  machine  to  arrive  at  a  machine  for  which  intuitive 
computational  procedures  are  easily  programmed.  These 
authors,  however,  also  define  a  graded  series  of  machines 
obtained  by  restricting  the  operation  and  changing  the 
definition  of  their  initial  URM  (Unlimited  Register 
Machine)  in  various  ways.  They  prove  such  results  as 
the  fact  that  a  machine  using  a  single  binary  tape  and 
having  two  control  heads --a  right-hand  head  that  can  write, 
move  only  to  the  right,  and  print  only  when  moving,  and 
a  left-hand  head  that  can  also  move  only  rightwards  and  read 
only  when  moving  (possibly  destroying  whatever  it  reads)-- 
is  a  universal  machine.  Ershov's  paper  seems  to  have  a  more 
unified  aim- -applications  to  the  theory  of  programming  and, 
in  particular,  to  the  development  of  programming  languages. 
It  does  take  a  while  before  one  gets  accustomed  to  his 
formalism  and  is  able  to  carry  out  computations  without 
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delay;  indeed,  the  format  of  the  papers  [25],  [32],  and 
[34]  resembles  much  more  closely  actual  computer  programs, 
the  basic  instructions  being  chosen  and  named  to  mirror 
actual  machine  operations.  For  example,  a  verbal  trans¬ 
lation  of  the  basic  instructions  of  the  URM  of  [32]  is 
as  follows:  (a)  add  1  to  the  number  in  register  n;  (b) 
subtract,  from  the  number  in  register  n;  (c)  clear  register 
n;  (d)  copy  from  register  m  into  register  n;  (e)  jump  to 
exit  1;  (f)  jump  to  exit  1  if  register  m  is  empty.  In  a 
word,  Ershov's  treatment  is  more  abstract.  This  is  possible 
because  of  his  careful  analysis  of  the  requirements  of  a 
formal  language  to  describe  algorithms  and  the  way  in  which 
those  features  are  built  into  his  definition  of  operator 
algorithm. 

3.3.7.  The  Amended  Definition.  In  [11],  Ershov  shows 
how  to  represent  computer  programs  and  the  logical  schemes 
for  programs  as  operator  algorithms.  He  amends  the  defini¬ 
tion  of  operator  algorithm  in  two  ways,  one  for  purely 
technical  convenience,  the  other  for  weightier  reasons. 

First,  a  zero-place  operation  is  defined  to  be  one  of 
the  form  A  where  the  word  (  )  is  not  a  subword  of  A.  If  A 

is  a  0-place  operation,  an  occurrence  of  an  expression  of  the 
form  A  =*  y  amounts  to  giving  the  variable  y  some  one  value. 
The  point  of  introducing  0-place  operations  is  that  they 
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reduce  the  number  of  parameters  required  in  an  operator 
algorithm . 

The  second  change  has  to  do  with  the  representation 
of  an  operator.  An  operator  is  a  word  of  a  definite  form, 
namely , 


Ti  -  yL*T2  -  y2*---*Tin  -  V 

where  Ti  ^  yi  for  i  =  l,2,...,m,  are  formulas.  They  occur 
in  an  algorithm  as  the  values  of  operator  variables.  The 
fact  that  the  values  of  the  operator  variables  must  be  of 
one  form  introduces  a  rigidity  into  the  definition . that 
can  be  disadvantageous.  For  example,  in  the  case  of 
algorithms  of  the  class  the  only  possible 

transformations  of  the  operator  variables  are  those  of  the 
form  x  39  y.  These  considerations  argue  for  including  a 
decoding  operation  in  the  definition  of  operator  algorithm 
that  would  allow  the  values  of  operator  variables  to 
assume  a  form  suited  to  the  given  class  of  algorithms  and 
be  subsequently  transformed  into  an  operator  upon  appli¬ 
cation  of  the  decoding  operation.  Ershov  maintains  that 
this  arrangement  is  consistent  with  computing  practice  in 


that  a  binary  representation  may  serve  as  either  a  number  or 
an  instruction,  depending  on  whether  it  appears  in  an 
arithmetic  or  control  register. 
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The  introduction  of  the  decoding  operation  into  the 
definition  of  operator  algorithm  necessitates  an  additional 
clause  in  the  definition  of  the  application  of  an  algorithm 
(Z  to  initial  data  d1 , , . . . , dg . ,  as  follows: 

Suppose  y  is  the  current  transition  variable  and  is  a 
member  of  the  operating  region  R  of  ^2.  and  has  the  current 
value  b'.  If  the  decoding  operation  is  not  defined  on  b '  , 
the  process  terminates  in  a  stop  without  result.  If  when 
applied  to  b'  the  operation  yields  b,  and  b  is  not  an 
operator,  the  process  terminates  in  a  stop  without  result; 
otherwise,  the  process  continues  as  previously  defined. 

3.3.8  The  Equivalence  of  Operator  Algorithms.  Ershov 
in  conclusion  turns  to  a  discussion  of  the  equivalence  of 
algorithms,  noting  both  the  theoretical  and  practical 
importance  of  this  problem.  The  measure  of  the  strength  of 
a  definition  of  equivalence  is  the  manner  in  which  the 
"output"  of  an  algorithm  is  defined.  If  equivalence  of 

algorithms  is  taken  to  mean  equal,  or  isomorphic,  outputs 
for  equal,  or  isomorphic,  inputs,  where  "output"  means  the 
final  result  in  the  usual  sense,  then  the  general  problem 
of  deciding  equivalence  is  recursively  unsolvable.  If  it 
means  that  for  all  admissible  inputs  two  algorithms  produce 
the  same  total  sequence  of  operations  in  the  same  order, 
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then  the  problem  is  recursively  solvable,  as  shown  by 

Yanov.  Ershov  feels,  however,  that  Yanov's  definition  is 

too  strong  and  that  it  excludes  many  algorithms  that  ought 

to  be  regarded  as  equivalent.  He  proposes  a  definition 

somewhere  between  Yanov's  and  the  general  one,  based  on 

the  notion  of  the  S -representation  of  the  value  of  an 

algorithm,  reasoning  that 

a  definition  of  equivalence  based  on  the  use  of 
the  S-representation  for  the  output  [enables  one] 

...  to  say  that  two  algorithms  are  equivalent 
with  respect  to  specified  variables  when  corres¬ 
ponding  variables  in  coinciding  inputs  are 
calculated  by  the  same  formulas.  This  is  so, 
inasmuch  as  the  S-representation  of  a  variable 
is  nothing  other  than  an  explicit  expression  of 
the  formulas  with  which  the  resulting  value  of 
the  variable  is  calculated. 

The  most  important  implication  of  what  we 
have  said  is  that  in  programming  (especially  at 
the  transition  from  logical  schemes  to  the  machine 
program),  obviously,  the  most  important  role  is 
played  by  transformations  of  algorithms  which 
leave  the  calculation  formulas  (i.e.,  the  S- 
representations )  intact.  Thus,  such  basic 
programming  devices  as  division  of  the  whole 
problem  into  parts  and  assigning  the  parts  to 
different  sections  of  the  machine's  memory, 
separation  of  subroutines,  partition  of 
formulas  and  identification  of  various  inter¬ 
mediate  results,  transformation  of  logical 
operators,  economizing  on  commands  and  working 
cells--all  these  lead  to  transformations  of 
algorithms  which  preserve  the  S-representation 
of  the  resulting  variable. 

Consider  now  operator  algorithms  and  of  the 

same  class  of  algorithms. 

Certain  variables  in  each  are  distinguished  by  the 
fact  that  they,  as  a  result  of  applying  the  algorithm,  take 
the  really  material  values.  It  is  assumed  that  there  is 
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a  1-1  correspondence  between  these  variables,  as  well  as 
between  the  functional  variables  and  those  parameters  in 
the  algorithms  that  can  enter  into  the  S -representations 
of  the  distinguished  variables.  Let  the  functional 
variables,  parameters,  and  distinguished  variables  of 
be,  respectively,  x1,...,xg,  Pl5...,Pr5  and  yi,...,yn, 
and  the  corresponding  variables  of  CI2.  t>e  x^,...,x  , 

Pl»  •  •  •  >Pr>  and  Yp  •  ■  *  >yn- 

d  ^  and  #2  are  said  to  be  equivalent  with  respect 
to  the  distinguished  variables  y^,...,yn  and  y  ^  >  .  .  . ,  yn 
if  for  all  initial  data  d,  ,...,d  wherever  one  of  the 
algorithms,  say  is  applicable  to  d-^,...,d  and  the 

S -representations  of  the  distinguished  variables  have 
the  form 


T  (x  ,...,x  ,p  ,...,p.  ,  )  «  y, 

i  in  jn  j^i  1 

z  121  12m2  J2l  y' 


J2  2' 


Tn('Xi  >Pj  »*‘,>Pj  ^  *  yn 

YJ  ^  T**W*>  d  T*l  «  0 


nm  "n. 
n  1 


n£ 


n 


then  the  other,  say  $2 ,  is  applicable  to  d^,..,^  and 
the  S-*- representations  of  the  distinguished  variables  have 
the  form 
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Tl(Xi11’"”Xil'yPj 


»p4  >•  •  •  »p^  i  m  y-\ 


11  J1  1 


T^(x.  ,  .  .  .  ,x.  ,p.  ,  .  .  .  ,p  .  £  )  ®*  3^2 

2  111  X2  2  J21  J"  " 


'2  2 


T  (x .  j  •  •  •  >P^ 

Xnl  nm  Jn, 

n  1 


,p .  ;  35  y 

Jn* 

n 


For  example,  consider  the  algorithm  for  addition 


d'tlA’A l): 

lju  *  s;  o  Jv  *  s;  3*  Jt  +  q*r  s;  5  Jp(q,x)  *  s; 
lj  y+1  =>  y*q+l  =*  q*r  s  s; 
v  J2 ;  tJl;  rj5;  u  Jl ;  y  J ;  xj. 


Let  cp  define  the  following  correspondence  between 
the  functional  variables,  parameters,  and  specified 
variables  of  d.'  (  2^,  and  the  previously  defined 

as  follows: 

cp(0)  =  1,  cp (1)  =  0,  cp(3)  =  3,  cp(5)  =  5,  cp(7)  =  7, 
cp(v)  =  V,  cp (t)  =  t,  cp (r)  =  r,  tp(u)  =  u,  cp(x)  =  y, 
cp  (y )  =  x. 

and  are  equivalent  with 

respect  to  y  and  x  in  the  sense  of  Ershov,  as  the  reader 
can  readily  check. 

To  cover  the  case  in  which  and  belong  to 
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different  classes  of  operator  algorithms  then  there  are 
the  following  additional  requirement:  there  is  an  | 
isomorphism  between  the  sets  of  operations  and  *2^ 

of  CL^  and  ,  respectively,  and  between  the  possible 
values  of  the  variables  in  the  sets  and  Under 

these  conditions,  and  are  said  to  be  equivalent  if 

when  applied  to  isomorphic  initial  data,  they  result  in 
S-representations  of  the  distinguished  variables  that 
coincide  up  to  isomorphism  of  the  operations  generating 
them. 


The  bulk  of  [11]  is  devoted  to  defining  two 

classes  ^CQ)  and  of  operator 

algorithms.  The  former  describes  the  programs  written  in 

machine  language  for  the  conventional  computer  (CC)  defined 
in  Lyapunov's  [21],  whereas  the  latter  describes  variants 
of  the  logical  schemes  used  as  input  information  to  the  PPS, 
the  compiler  for  the  Strela  machine.  Ershov  defines  an 
algorithm  from  each  of  these  classes  to  solve  a  pair  of 
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4 .  A  Comment 

An  editorial  comment  concerning  the  style  of  many  of 
the  papers  surveyed  is  in  order.  In  general,  the  style  is 
ponderous,  employing  much  symbolism.  The  dry,  atomistic 
analysis  will  be  egregiously  familiar  to  those  who  have  read 
papers  in  recursive  function  theory  by  Russian  authors, 
particularly  those  in  recursive  analysis.  A  special,  trying 

characteristic  of  some  of  the  papers-~of  [21],  [27],  and 
[19],  for  example--is  the  encyclopedic  recapitulation  of  the 

genesis  and  nature  of  programming. 

The  lengthy,  careful  preambles  are  in  this  case  sympto¬ 
matic  of  the  seriousness  of  the  whole  effort.  The  paper 
[21]  of  Lyapunov  initiated  a  systematic,  serious  attempt  to 
make  computer  programming  a  mathematical  discipline.  The 
semiformal  nature  of  the  operator  method  perpetuates  the 
view  of  programming  as  a  several-stage  process.  Indeed, 
Lyapunov  emphasizes  the  distinction  between  a  calculation 
scheme  and  a  program  scheme.  The  calculation  scheme  should 
be  the  result  of  the  analysis  of  the  algorithm  into  its 
major  parts,  and  is  the  symbolic  expression  of  the  algorithm 
as  the  combination  of  these  parts.  As  such  it  does  not 
reflect  any  of  the  characteristics  of  a  computing  machine. 

The  expansion  of  the  abstract  operators  of  the  calculation 
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scheme  as  the  product  of  various  kinds  of  control  operators, 
arithmetical  operators,  and  connecting  logical  conditions 
results  in  the  program  scheme,  which  does  reflect  some  basic 
characteristics  of  a  computing  machine.  For  example,  the 
control  operators  direct  that  the  memory  of  the  machine  be 
used  in  such  a  way  as  to  effect  successive  execution  of  the 
arithmetical  operators.  Prior  to  coding  the  program  scheme 
in  machine  language,  the  programmer  may  seek  to  improve  the 
scheme  in  order  to  produce  a  more  efficient  program  by 
applying  various  kinds  of  transformations.  Among  these 
transformations  are  those  closely  related  to  the  work  of 
Yanov,  namely,  transformations  of  the  logical  conditions 
present  in  a  program  scheme.  Indeed,  standard  Soviet  texts 
on  computing  machines  (such  as  [20])  include  chapters  on  the 
"formal  transformations  of  the  logical  schemes  of  programs." 

It  is  clear  that  learning  to  program  in  this  fashion  is 
a  more  arduous  task  than  learning  to  write  acceptable  programs 
in  a  language  such  as  FORTRAN. 

The  most  convincing  evidence  of  the  seriousness  of  the 
Soviet  effort  is  the  substantial  identity  of  those  who  are 
responsible  for  the  more  important  uses  of  the  operator 
method  and  those  who  have  developed  the  theory  surveyed  in 
this  study.  Thus,  if  one  looks  into  Soviet  work  on  automatic 
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programming,  he  frequently  reads  about  the  contributions 
of  A.  A.  Lyapunov,  his  pupils,  and  collaborators;  and, 
indeed,  the  mathematical  theory  herein  surveyed  is  due  to 
them.  Turski  writes  in  [33] :  "It  seems  that  apart  from 
several  interesting  exceptions ...  all  major  work  on  auto¬ 
matic  programming  in  the  USSR  is  done  in  notation,  and 
uses  concepts  and  definitions  conceived  by  Lyapunov's  team." 
Again,  A.  P.  Ershov  is  the  author  not  only  of  [10],  [11], 
and  [12],  but  also  of  [6],  [8],  and  [9].  It  is  well  to 
observe  here  that  this  commitment  to  the  development  of 
a  mathematical  theory  of  programming  on  the  part  of  inves¬ 
tigators  who  were  also  greatly  interested  in  practical 
matters  did  not  soon  cease:  Lyapunov  not  only  began  the 
investigation  in  [21],  but  also  initiated  a  more  abstract, 
algebraic  treatment  in  [22]. 

The  most  important  use  of  operator  methods  in  the 
Soviet  Union  has  been  for  the  automation  of  programming. 

By  contemporary  Western  standards  much  of  the  labor  asso¬ 
ciated  with  use  of  a  PP  must  appear  primitive  in  nature. 

The  already  toilsome  task  of  composition  of  program  schemes 
in  manual  programming  becomes  yet  more  taxing  when  the 
program  is  to  be  composed  with  the  assistance  of  a  PP. 

In  manual  programming  the  program  scheme  is  an  aid.  It 
serves  as  a  guide  to  the  writing  of  the  program  in  machine 
language,  and  hence  it  does  not  always  need  to  be  constructed 
in  full  detail.  But  a  program  scheme  used  as  an  input  to  a 


-125- 


PP  represents  the  programmer's  final  product.  It  is  the 
fruit  of  his  labor.  Thus  use  of  PPs  further  raised  the 
technical  nature  of  a  programmer's  work.  (In  contrast, 
in  the  United  States  at  about  the  same  time,  automatic 
programming  languages  such  as  FORTRAN  were  being  intro¬ 
duced  to  enable  virtually  anyone  having  a  moderately 
technical  background  to  learn  to  be  a  programmer.)  More¬ 
over,  until  quite  recently  no  Soviet-made  computer  had  a 
complete  alphanumeric  input -output  system.  In  fact, 
alphanumeric  key  punchers  have  been  scarce.  Thus,  generally, 
coding  has  had  to  be  done  in  machine  language  encoded  in 
digits  prior  to  key  punching.  The  machine  coding  of  an 
elaborate  program  scheme  increases  the  chance  of  the  pro¬ 
grammer  committing  miniscule  errors  that  are  hard  to  detect, 
but  ruinous . 

The  method  of  PPs  has  not  met  with  unanimous  accept¬ 
ance  within  the  Soviet  Union.  Criticism  and  an  alternate 
approach  are  given  briefly  in  [16].  The  PP  method  has, 
however,  been  one  of  the  principal  approaches.  Currently 
work  is  being  concentrated  on  various  modifications  and 
extensions  of  ALGOL  [1],  [8],  [7].  The  Soviets  regard 
the  introduction  of  ALGOL  as  a  major  pioneering  step  in 
the  development  of  automatic  programming  systems.  For 
example,  Ershov  states  in  [12]  : 

with  respect  to  the  language  ALGOL  60,  it  should 
be  recognized  that  with  its  appearance  there 
ensued  a  new  stage  in  the  development  of  the 
theory  and  automation  of  programming  and  there 
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emerged  new  levels  of  ideas  and  methods.  In 
the  first  place,  with  the  appearance  of  ALGOL  S3 
programming  really  became  an  international 
discipline,  not  only  because  ALGOL  is  used  as 
a  language  for  expressing  algorithms,  but  also 
due  to  the  increase  in  the  general  meaning  of 
results  connected  with  the  realization  of 
ALGOL.  Besides,  the  richness  of  its  means  of 
representation,  the  comparative  difficulty  of 
its  realization,  the  general  logical  level  of 
the  language,  in  particular  the  definition  of 
its  syntax  have  sharply  increased  the  role  of 
theoretical  research  in  the  design  of  translators. 

Programming  languages  such  as  ALGOL  were  developed  in 
the  West  and  were  designed  and  implemented  without  relying 
on  any  theory  comparable  to  that  deriving  from  the  opera¬ 
tor  method.  Thus,  the  major  question  concerning  the 
mathematical  theory  surveyed  herein  is:  If  the  means  of 


programming  and,  in  particular,  the  means  of  automatic 
programming  that  have  been  so  closely  allied  in  authorship 
and  direction  to  the  theory  surveyed  have  shifted  to  the 
use  of  higher  level  languages  utterly  independent  of  the 
theory,  is  the  development  of  the  theory  to  be  further 
pursued,  and,  if  so,  to  what  end? 

The  theory  has  had  some  effect  on  automatic  program¬ 
ming  systems.  The  Yanov  notation  is  used  in  defining  value 
assignments  of  variables  in  [163 .  Also,  it  is  plausible 
that  the  transformations  of  Yanov  are  being  used  in  the 
Alpha-translator  of  the  Alpha  automatic  programming  system 
developed  by  A.  P.  Ershov  and  his  colleagues  at  Novosibirsk. 
In  [12],  Ershov  gives  a  transcription  of  the  transformations 
of  Yanov  in  terms  of  graph  schemes  and  presents  the  system 
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in  connection  with  the  algebraic  problems  arising  in 
construction  of  a  translator.  In  L 9  ],  he  says  in  reference 
to  the  Alpha  translator:  "The  main  methods  of  improving 
the  efficiency  of  programming  are  the  applications  of 
formal  transformations  and  a  mixed  strategy  of  programming-- 
all  this  as  the  basis  of  multiphase  translation."  In 
describing  this  multiphase  translation,  he  states  that 
the  "work  of  the  translation  proper  goes  from  the  highest 
level  language  into  the  lowest  one  and  is  followed  by  a 
series  of  a  formal  transformation  on  the  lowest  level  language, 
oriented  toward  the  optimization  of  the  object  program." 

He  proceeds  to  list  five  catagories  of  these  optimizing 
transformations ,  and  at  least  some  of  these  categories 
could  make  use  of  Yanov's  work--for  example,  the  category 
of  eliminating  redundant  expressions  in  unbranched  parts 
of  an  Alpha  program. 

As  for  future  practical  applications  of  the  theory, 
some  authors  expect  big  things  to  come.  For  example, 

Turski  in  [33]  affirms:  "There  is  no  doubt  when  alphanumer¬ 
ical  devices  become  widely  available  for  Soviet-made 
computers,  the  tremendous  theoretical  work  done  in  that 
country  will  ripen  into  many  interesting  automatized 
programming  systems." 
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Irrespective  of  whether  this  has  been  borne  out  in 
the  Alpha  programming  system,  we  think  that  this  statement 
is  probably  unduly  optimistic*  at  least  insofar  as  the  later 
theory  surveyed  in  this  report  is  concerned.  Thus,  it  may 
well  be  that  Lyapunov  in  confidently  noting  the  strong 
similarity  between  the  transformations  that  occur  in 
computer  programming  and  those  of  the  theory  of  categories 
has  exaggerated  the  situation.  It  would  be  foolish,  however, 
to  rule  out  the  possibility  of  the  practical  relevance  of 
this  work.  In  this  connection,  the  question  arises  as  to 
the  possible  use  in  automatic  programming  of  the  work  of 
Glebov  on  the  synthesis  of  operators  of  a  given  class  from 
measurably  simpler  operators  of  that  class. 

It  is  also  quite  likely  that  Ershov's  reformulation 
of  the  notion  of  algorithm  was  of  use  to  him  in  his  work 
on  automatic  programming  languages.  His  latest  theoretical 
efforts  are,  however,  somewhat  puzzling.  After  in  [H] 
criticizing  Yanov's  definition  of  the  equivalence  of  two 
algorithms  as  being  too  narrow  to  be  of  practical  value 
and  proposing  an  alternate  presumably  wider  definition, 
he  in  [13],  so  far  as  can  be  adduced  from  [12],  works  with 
Yanov's  definition,  and  derives  Yanov's  equivalence  theorem 
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in  a  graph-theoretic  formalism.  What  is  the  reason  for 
this  apparent  backsliding?  Has  any  research  been  conducted 
connected  with  decision  problems  relative  to  his  own 
definition? 

The  most  reliable  answers  to  these  questions  should 
probably  be  obtained  from  the  authors  of  the  papers 
reviewed.  Otherwise,  we  will  just  have  to  wait  and  see 
if  the  questions  are  resolved  by  the  contents  of  future 
publications . 
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